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The  purpose  of  this  study  was  to  examine  the  Doctor  Fox  etiect 
(which  is  the  primary  influence  of  expressive  teaching  behaviors  on 
student  ratings  of  instruction)  when  students  were  given  the  opportu- 
nity to  compare  lectures  of  varying  levels  of  content  and  expressiveness. 
Also,    it  was  to  examine  what  students  say  are  instructor  character- 
istics which  cause  them  to  rate  one  lecture  presentation  as  better  than 
another,    and  thus,    yielding  insight  into  specific  characteristics  of  r.he 
expressiveness  dimension  of  the  Doctor  Fox  effect. 

For  this  study  copies  of  tapes  used  in  the  original  Doctor  Fox 
studies  were  used.      The  first  five  m.inutes  of  four  of  the  lectures  (high 
content-high  exoressiveness,    high  content-low  expressiveness,    low 
content-high  expressiveness,    and  low  content-lov/  expressiveness)  on 
•■The  Biochemistry  of  Memory"  were  used.      The  high  content  segments 
concained  six  teaching  points;    low  content  segments  contained  no 
teaching  points.      The  four  segments  were  paired  to  vield  all  16  orcered- 
pair  combinations,    and  thus,    16  treatm.ent  groups. 


The  278  subjects  were  randomly  assigned  within  intact  classes 
to  the  16  treatment  conditions.      They  viewed  Lecture  A  of  the  pair, 
rated  it,    viewed  Lecture  B  of  the  pair,    rated  it,    selected  which  of  the 
cvvo  lecture  presentations  was  the  better  presentation,    and  finally 
selected  adjectives,    characteristic  of  the  instructor,    which  influenced 
their  choice  of  the  better  presentation.      The  dependent  measures  were 
a  total  student  ra.ting  score  (the  same  rating  instrument  as  in  the  ori- 
ginal Doctor  Fox  studies),    a  lecture  choice  variable,    and  a  choice/no 
choice  on  each  of  the  adjectives  on  the  checklist. 

Separate  analyses  on  the  dependent  variables  for  Lecture  A, 
Lecture  B,    the  lecture  choice  variable,    and  for  the  adjectives  were 
conducted.     The  2  x  Z  (content  x  expressiveness)  analysis  for  Lecture 
A  yielded  the  following  results:     (1)  a  significant  interaction  between 
content  and  expressiveness  for  total  score  on  the  student  rating  instru- 
ment;    (2)  a  significant  difference  in  higher  ratings  of  high  content 
lectures  versus  lovv^  content  lectures  when  expressiveness  was  high; 
and  (3)  a  significant  difference  in  higher  ratings  of  high  expressiveness 
versus  low  expressiveness  lectures  for  both  levels  of  content.     The 
2x2x2x2  (content  x  expressiveness  of  Lecture  A  x  content  x 
expressiveness  of  Lecture  B)  analysis  of  Lecture  B  yielded  the  follow- 
ing results:     (1)  a  significant  interaction  between  content  and  expressive- 
ness for  Lecture  B;     (2)  a  significant  difference  in  higher  ratings  of 
high  expressiveness  versus  low  expressiveness  lectures  for  both  levels 
of  content  for  Lecture  3;    and  (3)  the  high  and  low  expressiveness 
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preconditions  of  Lecture  A  produced  a  significant  difference  in  ratings 
of  Lecture  B  for  both  levels  of  content  for  Lecture  A.      The  chi- square 
analysis  of  the  lecture  choice  variable  showed  a  significant  frequency 
distribution  between  choice  of  Lecture  A  versus   Lecture  B.      The  chi- 
square  analysis  of  the  adjectives  yielded  21   adjectives  which  had  signi- 
ficant frequency  distributions;    18  adjectives  showed  a  trend  toward 
relationship  with  the  high  expressiveness  lectures. 

Because  of  the  above  results,    the  following  conclusions  were 
drawn:     (1)    High  expressiveness  of  lecturing  style  has  a  major  influ- 
ence on  student  ratings  of  instruction.      (2)    After  viewing  two  lecture 
presentations,    student  ratings  of  the  second  lecture  presentation  were 
influenced  by  the  expressiveness  of  the  first  lecture  presentation. 
(3)    The  following  adjectives  are  most  descriptive  of  the  Doctor  Fox 
expressive  teaching  style:     dramatic,    energetic,    inspiring,    expressive, 
forceful,    interesting,    stimulating,    interested,    warm,    motivating, 
enthusiastic,    showmanship,    enjoyable,    humorous,    sparkling,    dynamic, 
witty,    and  persuasive.      (4)    The  Doctor  Fox  effect  holds  up  when 
students  are  given  the  opportunity  to  compare  two  lectures  varying  in 
content  and  expressiveness. 
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Chapter  I 

INTRODUCTION 

The  Doctor  Fox  effect  originally  appeared  in  the  literature  in 
1970  (Ware  et  al.  ,    1970  a  and  b).     The  idea  for  the  Doctor  Fox  effect 
stemmed  from  the  work  of  Erving  Goffman,    specifically  his  notion  that 
expressive  behavior  may  influence  an  audience  as  much  as  or  nn.ore 
than  substance  when  there  is  little  time  or  reason  for  the  audience  to 
evaluate  the  presentation  (Goffman,    1959).      There  are  two  basic  premx- 
ises  behind  the  Doctor  Fox  effect.     One  premise  is  that  highly  expres- 
sive behavior  of  a  teacher  will  have  primary  influence  on  and  be  a 
determining  factor  of  student  ratings  of  instruction.      The  second  prem- 
ise is  an  outgrowth  of  the  first  premise.     It  states  that  stucents  will 
be  unable  to  distinguish  between  lectures  of  different  levels  of  content 


when  exposed  i:o  a 


lecturer  v/ith  a  highly  expressive  lecturing  styl; 


Purpose  of  the  Study 
The  purpose  of  this  study  is  to  exam.ine  students'  ability  to  "see 
through''  the  Doctor  Fox  effect  when  given  the  opportunity  to  compare 
lectures  of  varying  levels  of  content  and  expressiveness.     Also,    it  is 
to  examine  v/hat  students  say  are  the  factors  which  cause  thein  to  rate 
one  lecture  presentation  as  better  than  another.     Specifically,    the 
study  will  yield  an  insight  into  the  specific  characteristics  of  the 


expressiveness  dimension  of  the  Doctor  Fox  effect.     Also,    the  purpose 
is  to  retest  a  portion  of  the  originally  stated  Doctor  Fox  effect,    that 
being  that  students  are  unable  to  distinguish  levels  of  content  when  the 
content  is  accompanied  by  a  highly  expressive  lecture  presentation. 

Specifically,    the  purpose  of  this  study  was  to  examine  the  follow- 
ing research  questions: 

1.      Do  levels  of  lecturer  expressiveness  and  levels  of  lecture 
content  interact  with  each  other  in  affecting  student  evaluation  of  lec- 
turer effecti^-eness'^ 

Z.     After  viewing  a  second  lecture  presentation  varying  in  con- 
tent and/or  expressiveness  from  the  first  lecture  presentation,    do  the 
levels  of  content  and  levels  of  expressiveness  of  this   second  lecture 
interact  v/ith  the  levels  of  content  and  levels  of  expressiveness  of  the 
first  lectare  presentation  in  affecting  the  student  evaluation  of  lecturer 
effectiveness? 

3.  Are  there  differences  in  student  evaluations  of  lecturer 
effectiveness  for  lectures  which  are  high  in  expressiveness  as  opposed 
to  those  which  are  lovv*  in  expressiveness? 

4.  Does  the  level  of  content  in  a  lecture  presentation  affect 
student  evaluation  of  lecturer  effectiveness? 

5.  Are  there  differences  in  student  choices  of  adjectives,    char- 
acteristic of  the  instructor,    to  describe  what  they  feel  is  a  better 
lecture  presentation? 


Significance  of  the  Study 

While  Williams  and  Ware  (1977)  have  attempted  to  establish  the 
Doctor  Fox  effect  over  two  consecutive  lectures,    they  have  not  tested 
the  effect  by  providing  students  with  an  opportunity  to  compare  lec- 
turer expressiveness  and  lecture  content.      If  students  are  able  to  iden- 
tify the  expressiveness  elemient  of  a  lecturer  and  yet  are    unable  to 
identify  content  when  given  the  opportunity  to  compare  two  lectures,  then 
it  may  be  that  the  Doctor  Fox  effect  can  be  shown  to  be  a  strong  deter- 
miner of  student  ratings.     If  this  is  the  case,    then  the  highly  expres- 
sive behaviors  might  be  taught  to  teachers  to  improve  their  lecturing 
technique. 

On  this,    there  are  two  points  of  significance  v/hich  relate  speci- 
fically to  the  college  setting.      The  first  point  is  that  there  is  a  strong 
movement  in  higher  education  institutions  to  set  up  and  to  develop  pro- 
grams for  improving  the  quality  of  college  teaching  (Boyd  and  Schie- 
tinger,    197o;    Gaff,    1975;    Seldin,    1975).     Among  the  techniques  being 
used  for  faculty  development  programs,    systematic  observation 
attempts  to  identify  specifically  the  teaching  behaviors  of  the  college 
professor.      This  study  continues  the  efforts  to  identify  what  are  suc- 
cessful teaching  behaviors.     As   such,    the  findings  of  this   study  have 
im.plications  for  the  continued  efforts  to  im.prove  college  teaching  and 
to  provide  effective  faculty  developm.ent  prog  rains. 

The  second  point  of  significance  for  this  study  concerns  the 
increased  use  of  stu.dent  ratings  and  other  teacher  effectiveness  data 


in  personnel  decisions,    such  as  promotion,    tenure,    and  salary  in- 
creases,   made  by  college  administrators  about  teaching  faculty 
(Greenwood,    1977;    Greenwood  and  Renner,    1975).     Since  the  expres- 
sive behaviors  of  the  Doctor  Fox  effect  have  been  shown  to  be  related 
to  both  student  ratings   and  to  student  achievement,    the  results  of  this 
study,    particularly  those  results  concerned  with  these  expressive  be- 
haviors,   could  have  strong  implications  for  researchers  studying  the 
validity  of  student  ratings  and  for  college  administrators  concerning 
the  validity  of  the  use  of  student  rating  data  sources  for  personnel 
decision-making. 

Moreover,    this  study  has  important  im-plications  for  the  educa- 
tional psychologist.      The  educational  psychologist  is  interested  in  the 
nature  of  teaching,    the  effect  of  teaching  upon  the  student  in  the  class- 
room,   and  the  effect  of  teaching  on  learning  in  the  classroom.      This 
experiment  sheds  some  light  on  part  of  the  effect  of  teaching  style  and 
presentation  m  a  lecture  situation.      It  is  designed  to  retest  that  portion 
of  the  Doctor  Fox  effect  dealing  with  the  impact  of  expressiveness  on 
students'  perceptions  of  teacher  performance.      If  this  experiment 
shows  that  the  observations  of  the  effects  of  expressiveness  on  student 
ratings  are  valid,    then  the  next  step  would  be  to  examine  the  validity 
of  the  effects  of  expressiveness  on  learning  and  achievement.      This 
is  cf  tremendous  imxportance  for  teacher  training  and  faculty  develop- 
m.ent  at  the  college  level. 


Thus,    this  study  deals  with  the  effect  of  expressiveness  and 
content  level  on  student  perceptions  of  teacher  presentation  as  meas- 
ured by  a  student  rating  instrument.     Also,    it  deals  with  whether  or 
not  the  student  can  identify  those  elements  of  expressiveness  in  (.he 
Doctor  Fox  effect.     In  summary,    this  study  is  designed  to  fill  a  gap 
in  the  Doctor  Fox  literature,    since  no  studies  providing  for  an  imme- 
diate comparison  between  lecture  presentations  have  been  done  to 
date;    to  provide  a  possible  confirmation  of  the  Doctor  Fox  effect, 
that  is,    the  finding  that  high  expressiveness  of  lecturing  style  has  a 
primary  influence  on  student  ratings  and  that  high  expressiveness 
tends  to  mask  content  level  of  a  lecture  presentation;    to  establish 
empirically  the  high  expressive  behaviors   (these  behaviors  identified 
should  be  of  use  in  improving  the  lecture  style  of  professors);    and 
to  add  further  to  the  research  regarding  the  validity  of  student  ratings 
of  college  professors,    particularly  as  they  are  used  in  administrative 
decision-making  (e.  g.    promotion,    tenure,    and  salary  increases). 


Chapter  II 

REVIEW    OF    RELATED    LITERATURE 

In  this  chapter  the  literature  related  to  the  Doctor  Fox  effect, 
as  well  as  the  Doctor  Fox  literature  is  reviewed.     Specifically,    the 
literature  on  the  use  of  student  ratings  in  colleges  and  universities, 
the  literature  on  the  validity  of  student  ratings,    and  the  Doctor  Fox 
literature  are  examined.     These  three  bodies  of  literature  present  a 
set  of  interrelated  issues.     The  increased  use  of  student  ratings  of 
faculty  by  college  administrators  for  personnel  decisions  is  of  inter- 
est because  of  the  inconclusive  results  in  the  validation  of  student 
ratings.     This  inconclusiveness  of  the  validity  of  student  ratings  can 
be  examined,    and  partially  can  be  explained  by  the  findings  on  the 
Doctor  Fox  effect,   which  conclude  that  student  ratings  of  instruction 
are  primarily  influenced  by  a  high  degree  of  lecturer  expressiveness 
in  lecturing  style  and,    secondarily,    that  this  high  expressiveness 
tends  to  mask  student  ability  to  identify  lecture  content. 

The  Use  of  Student  Ratings 
One  issue  raised  in  relation  to  student  ratings  of  instruction  is 
their  continued,    increased  use  in  administrative  decision-making, 
specifically  regarding  faculty  promotion,    tenure,    and  salary  increases. 


This  issue  is  paradoxical  since  the  use  of  student  ratings  of  instruction 
often  is  not  combined  with  a  program  of  faculty  development  and  instruc- 
tional improvement  (Smith,    1976).      Two  surveys  serve  to  point  out  this 
increase  in  use  for  administrative  decision-making. 

Seldin  (1975)  surveyed  colleges  and  universities  across  the 
country  as  to  whether  or  not  they  used  student  ratings  and  secondly, 
how  they  used  student  ratings  when  they  used  them.     More  than  one- 
half  of  the  liberal  arts  colleges   state  that  they  use  student  ratings,    in 
some  form  or  another,    to  evaluate  faculty  performance.      Further, 
more  than  bOfo  of  all  colleges  and  universities  state  that  the  primary 
use  for  their  student  ratings  was  to  evaluate  faculty  teaching  perform- 
ance for  use  in  administrative  decision-making. 

Eoyd  and  Schietinger  (197  6)  surveyed  colleges  and  universities 
in  the  southern  region  of  the  U.    S.    for  the  Southern  Regional  Education 
Board.     Their  results  confirmed  the  trends  cited  by  Seldin  (197  5)  and 
shovv-ed  that,    at  least  in  southern  colleges  and  universities,    the  trends 
were  becoming  more  widespread.      They  found  that  62%  of  doctoral 
institutions  use  student  ratings  of  instruction  for  nnaking  administra- 
tive decisions  about  the  faculty.     In  addition,    they  found  that  large  uni- 
versities have  little  or  no  concern  for  the  use  of  student  ratings  of 
instruction  for  faculty  development  programs.     Still  further,    they 
fotmd  that  the  primary  users  of  student  ratings  for  decision-making 
purposes  are  academic  deans  and  departnnsnt  c.^iairmen.     Finally,    they 
found  that  88%  of  all  the  institutions  surveyed  use  student  ratings  of 
instructions  for  decision-making. 
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This  use  of  student  ratings  for  decision-making  has  prompted 
comments  from  many  individuals  and  researchers.      For  example, 
McKeachie  (1969)  raised  the  question  of  the  use  of  student  ratings  for 
personnel  decision-making  and  contended  that  students  are  qualified 
to  evaluate  teaching  effectiveness.      Centra  (197  3)  reviewed  the  prob- 
lem of  the  use  of  student  ratings  for  decision-making  v/ith  regard  to 
retention,    promotion,    and  tenure.      Ke  reported  a  survey  in  which 
students  stated  that  they  believe  that  their  ratings  of  instruction 
should  be  the  basis,    at  least  in  part,    for  decisions  relating  to  promo- 
tion.     Greenwood  and  Renner  (197  5)  reviewed  the  literature  on  the  use 
of  student  ratings  and  point  out  that  the  lack  of  validity  of  student 
ratings  places  their  use  in  question.      Further,    they  called  attention 
to  the  fact  that  there  is  some  agreement  that  somxe  measure  of  student 
outcome,    i.e.    student  achievement  data  in  some  form,    should  be  the 
basis  of  validation  for  student  ratings  of  instruction.      Yet,    they  con- 
cluded that  the  am.bivalence  of  the  results  of  validation  research 
raises  questions  of  the  reasonableness  for  the  use  of  student  ratings 
in  admiinistrative  decision-making. 

Another  problem  with  the  validity  of  student  ratings  is  created 
when  students  are  informed  of  the  use  to  be  made  of  their  ratings  of 
the  instructor.     Aleamoni  and  Hexner  (1973)  found  that  when  students 
were  told  that  their  ratings  were  to  be  used  for  promotion  and  tenure 
decisions,    these  students  gave  significantly  different  ratings  of  their 
instructors  when  these  ratings  were  compared  to  students  who  were 


not  told  of  the  use  of  the  ratings.     Abrami  et  al.    (1976)  found  that 
students  rate  their  instructors  more  positively  when  they  are  told 
that  the  faculty  association,    as  opposed  to  the  student  association, 
is  sponsoring  the  evaluations  of  the  instructors.      Lunney  (1973)  con- 
cluded that  seniors  at  a  small  liberal  arts  college  would  prefer  that 
any  evaluations  of  faculty,    that  they  did,    be  used  for  feedback  in  aiding 
an  instructor  to  improve  the  course  and  his  teaching;    they  did  not  want 
their  evaluations  used  for  administrative  decision-making.     Alexander 
(1973)  found  that,    if  students  thought  their  rating  would  affect  the  sal- 
ary of  the  instructor,    47%  of  the  students   satisfied  with  an  instructor 
would  change  their  rating  of  the  instructor,    and  98.  8%  of  these  would 
make  it  higher.     Of  the  29.  5%  who  were  dissatisfied,    84.  4%  would 
lower  their  rating  of  the  instructor.     Alexander  concluded  that  students 
will  punish  or  reward  an  instructor  by  a  change  in  ra.tings,    if  the  stu- 
dents know  the  ratings  will  affect  that  instructor's  salary. 

There  are  two  important  points  which  have  been  raised  thus  far. 
One  point  is  that  there  seems  to  be  a  consensus  of  opinion  that  there 
is  an  increased  use  of  student  ratings  of  instruction  as  a  primiary  part 
of  administrative  decision-making  with  regard  to  faculty  promotion, 
tenure,    and  salary  increases.      The  second  point  is  that  there  is  a 
growing  concern  over  the  validity  of  student  ratings,    particularly  in 
light  cf  how  the  ratings  are  affected  by  students'  perception  of  how 
these  ratings  will  be  used.      This  second  concern,    the  validity  of  stu- 
dent ratings,    is  considered  next. 
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The  Validity  of  Student  Ratings 
As  indicated  above,    there  is  an  ambivalence  in  the  results  of 
validity  research  conducted  on  student  ratings  of  instruction.      How- 
ever,   what  seems  clear  is  that  the  most  accepted  method  for  validating 
student  ratings  is  to  compare  them  with  student  achievement  scores. 
Rosenshine  (1971)  and  Cohen  et  al.    (1973)  reviewed  validation  studies 
of  student  ratings  against  achievement  data.     While  they  pointed  out 
the  inconclusiveness  of  the  validation  results  to  date,    they  found  that 
the  primary  validation  instrument  or  measure  is   some  measure  of 
student  final  outcome;  either  an  achievement  test,    a  final  examination, 
or  a  final  grade  in  the  course.      Twenty  of  the  studies  reviewed  used 
achievement  gain  as  the  validation  outcoine  measure.     Cook  and  Neville 
(1971)  advocated  the  use  of  both  achievement  outcome  (as  a  direct 
measure)  and  student  ratings  of  instruction  (as  an  indirect  outcome)  to 
combat  some  of  the  problems  that  relate  to  the  validity  of  student 
ratings. 

Costin  et  al.    (1971)  reviewed  119  publications  that  dealt  with  the 
validity  of  student  ratings.      They  found  that  single  achievement  meas- 
ures,   primarily  student  grades,    are  correlated  with  student  ratings 
and  generally  yield  correlations  in  the  neighborhood  of  .3  5.      They  con- 
cluded that  scudent  ratings  do  not  provide  a  complete  assessment  of 
teaching  effectiveness.     In  another  review  of  five  studies,    McKeachie 
et  al.    (1971)  found  both  positive  and  negative  correlations  bet'^veen  stu- 
dent ratings  and  achievement.      They  concluded  that  validation  should  be 
done  with  student  learning  gains  in  relationship  to  student  ratings. 
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Some  studies  of  the  relationship  between  student  ratings  and 
achievement  gain  yielded  mixed  results.     Rodin  and  Rodin  (1972) 
reported  a  -.  75  correlation  between  student  ratixigs  of  teaching  assis- 
tants and  achievement  gain.      Gessner  (1973)  found  a  high  positive  cor- 
relation between  student  ratings  and  achievement  gain  on  a  national 
achievement  test  and  a  low  positive  correlation  between  student  ratings 
and  a  departmental  examination.     In  addition,    Gessner  found  that  stu- 
dent ratings  are  related  to  students'  previous  knowledge  of  the  subject. 
Greenwood  et  al.    (1976)  found  no  correlation  between  four  types  of 
student  rating  instruments  and  achievement  gain  in  mathematics. 
Turner  and  Turner  (1974)  found  negative  correlations  between  student 
ratings  and  student  achievement.     McGuigan  (J  974),    in  correlating 
achievement  (achievement  gains,    final  examination  score,    and  course 
grades)  with  student  ratings,    concluded  that  how  much  a  student  learns 
is  a  preferable  way  (as  opposed  to  student  ratings)  to  evaluate  faculty. 

A  different  approach  to  the  validity  of  student  ratings  was  to 
compare  other  types  of  faculty  evaluation  ratings  with  achievement 
and  student  ratings.      Fcllman  and  Merica  (1973)  compared  student 
ratings,    supervisor  ratings,    peer  ratings,    and  self  ratings  with  student 
achievement  and  found  correlations  in  the  magnitude  of  .  3  5.      They  con- 
cluded that  student  ratings  are  as  good  as  the  other  types  of  ratings,    in 
tern\s  of  validation  against  student  achievement,    in  evaluating  teaching 
effectiveness.     Blackburn  and  Clark  (1975)  found  that  student  ratings 
are  as  effective  as  peer,    administrator  (deoartment  chairman),    and 
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self  ratings  in  evaluating  teaching  effectiveness,    when  all  the  above 
ratings  are  compared  to  student  achievement. 

Touq  et  al.    (1973)  tried  still  another  approach  to  validating  stu- 
dent ratings.      They  developed  a  student  rating  instrument  which  paral- 
leled the  Flanders  Interactional  Analysis  System.      The  subject  teachers 
were  observed  systematically  by  expert  observers  and  these  results 
were  compared  to  the  student  ratings  of  the  same  instructors.      They 
found  that  student  ratings  agreed  with  the  systematic  observation  on 
four  out  of  the  nine  interactional  categories  on  the  Flanders  system. 

A  different  twist  to  the  above  approach  was  used  by  a  number  of 
researchers.      In  their  research  they  attempt  to  validate  certain  aspects 
of  student  ratings  which  seem  to  be  more  effective  in  assessing  faculty- 
performance.      Frey  et  al.    (197  5)  found  that  previous  student  accom- 
plishment,   presentation  clarity,    and  organizational  planning  correlate 
highly  with  a  final  examination  score.      They  concluded,    along  with 
Sullivan  and  Skanes  (1974)  and  Centra  (1977),    that  organizational  and 
presentation  skills  are  a  more  valid  indicator  of  teaching  effectiveness 
than  measures  of  student/teacher  interaction.     Centra  (1977)  reported 
that  global  ratings  of  teachers,    ratings  of  lectures,    ratings  of  courses, 
and  ratings  of  course  objectives  and  organization  are  the  student  rating 
types  most  highly  related  to  student  achievement.     Whitely  and  Doyle 
(1974,    1976)  and  Leventhal  et  al.    (1976)  concluded  that  student  ratings 
of  teaching  effectiveness  are  affected  by  previous  student  experience  of 
instructors  and  the  selection  of  teachers  based  on  the  teacher's  ability 
and/or  reputation,    respectively. 


13 

From  the  above  re'/iew,    the  following  summary  statements  about 
the  literature  can  be  made.      (1)    There  is  an  increased  use  of  student 
ratings  of  instruction  by  college  administrators  for  personnel  decision- 
making affecting  faculty  promotion,    tenure,    and  salary  increases.      (2) 
The  student  ratings  of  instructors  are  influenced  by  the  student  percep- 
tion of  how  these  ratings  will  be  used.      (3)    A  number  of  approaches  to 
validating  student  ratings  have  been  used.     As  of  this  writing,    the  results 
of  these  validation  studies  are  mixed  and  inconclusive,      (4)    This  incon- 
clusiveness  of  validation  results  has  increased  the  concern  over  the 
validity  of  the  use  of  student  ratings  by  administrators  for  personnel 
decision-making.      This  question  of  the  validity  of  student  ratings  also 
has  been  examined  by  the  direct,    experiinental  nnanipulation  of  teaching 
style.     A  review  of  this  literature  is  presented  next. 

The  Doctor  Fox  Literature 
The  Doctor  Fox  effect  originally  appeared  in  the  literature  m 
1?70  (Ware  et  al.  ,    1970  a,    b).      The  idea  for  the  Doctor  Fox  effect  stem- 
med fron'i  the  work  of  Erving  Goffman,    specifically  his  notion  that 
expressive  behavior  may  influence  an  audience  as  rr.uch  as  or  more 
than  substance  when  there  is  little  time  oi   reason  for  the  audiex-ice  to 
evaluate  the  presentation  (Goffman,    1959).      Expressiveness,    or  seduc- 
tiveness,   has  been  identified  with  lecturer  characteristics  such  as 
enthusiasm,    humor,    friendliness,    charisma,    and  personality  in  various 
correlational,    factor  analytic,    and  experinientai  studies  of  teacher  be- 
havior   as  related  to  effective  teacher  behaviors  (Rosenshine  and  Furst, 
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1971;    Coffman,    1954;    Isaacson  et  al,  ,    1964;    Solomon,    1966,    Coacs  and 

Smidchens,    1966;    Harry  and  Goldner,    1972;    Finkbeiner  et  ai.  ,    1973). 

Ware  (1974)  defined  expressiveness  as  follows: 

...    a  number  of  different  terms  have  been  used, 
all  of  which  appear  to  refer  to  the  seduction- 
expressiveness  aspect  of  teaching  effectiveness, 
including:     "charisma'',    "dynamism",    "emotional 
appeal",    "friendliness",    "interest",    "personality", 
"seduction",    "stimulation",    and  "warmth". 
Seduction-expressiveness  is  operationally  defined 
as  the  extent  to  which  these  mannerisms  are 
present  in  the  lecture  presentation,      (p.    4) 

Some  research  has  been  conducted  which  sheds  light  on  the  effect 
of  expressiveness  in  teaching.      Carpenter  and  Hadden  (1964)  and  Fish- 
bein  (1972)  found  that  students  are  unable  to  detect  lack  of  substance  in 
seductive  lectures.     Browne  and  Anderson  (1974)  concluded  that  there  is 
a  lack  of  student  sensitivity  to  variations  in  instructional  style,    specifi- 
cally that  students  could  not  detect  variations  in  communication  structure 
as  related  to  their  degree  of  knowledge  acquisition.     Mastin  (1963),    who 
studied  high  school  students,    found  that  students  who  heard  enthusiastic 
teachers  learn  more  and  have  more  favorable  course  attitudes  than 
students  of  less  enthusiastic  teachers.      Coats  and  Smidchens   (1966), 
who  used  no  outcome  measures,    concluded  that  dynamic  lectures  result 
in  higher  student  achievement  than  less  dynamic  lectures.     And  finally, 
Zelby  (1974),    who  took  a  different  perspective  on  the  idea  of  expressive- 
ness in  lectures,    concluded  that  faculty  can  teach  so  as  to  obtain  more 
favorable  student  ratings  for  particular  instructor  and  course  character- 
istics  (enthusiasm). 
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The  first  of  the  Doctor  Fox  studies  was  reported  by  Naftulin  et  al. 
(1973),  The  conclusiorx  from  this  study  was  that  three  groups  of  experi- 
enced educators  were  satisfied  with  the  amount  the/  learned  in  a  lecture 
presented  by  Dr.  Fox,  despite  the  fact  that  the  lecture  itself  was  low  in 
content  coverage  (and  high  in  expressiveness).  Kaplan  (1974)  criticized 
this  original  study  on  two  fronts: 

1.     that  it  was  not  possible  to  determine  if  the  Doctor  Fox 
effect  was  due  to  the  style  of  the  lecture  presentation 
or  due  to  the  impressive  credentials  given  to  Dr.    Fox, 
and 
Z.     that  there  was  no  item  on  the  lecture  evaluation  question- 
naire which  asked  about  learning,    that  is  to  say  that  there 
was  no  way  to  establish  whether  the  subjects  had  the 
illusion  of  having  learned. 
The  Doctor  Fox  studies  were  an  extension  of  the  above  research 
and  criticism;    these  studies  took  an  experimental  approach  to  the  prob- 
lem of  the  effect  of  the  expressiveness  of  teachers.      They  did  this  by 
varying  the  amount  of  expressiveness  with  amount  of  content  coverage 
in  a  lecture.     Specifically,    the  design,    which  involved  the  use  of  a  pro- 
fessional actor  as  Dr.    Fox,    was  a  3  x  2  factorial  design  with  three 
levels  of  content  coverage  (high,    medium,    and  low)  and  two  levels  of 
expressiveness  (high  and  low)  for  the  lect-ares  iWare,    1974).      The  lec- 
tures were  videotaped  and  shown  to  six  groups  of  students. 

Ware  and  V/illiams   (197  5a)  reported  that  student  ratings  of  an 
instructor  are  not  sensitive  to  the  amount  of  information  covered  in 
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lectures,    even  though  student  achievement  is  affected.     Specifically  they 
found  that,    under  high  seductive  (expressiveness)  conditions,    the  stu- 
dents could  not  distinguish  between  a  high  content  coverage  lecture  and 
a  low  content  coverage  lecture.      Further,  they  found  that  difference  in 
lecture  content  coverage  and  lecturer  seductiveness  appeared  to  affect 
both  student  ratings  and  student  test  performance.      In  another  reporting 
of  this  effect,    Ware  and  Williams  (1975b  and  1977)  found  that  differences 
in  faculty  information- giving  are  easier  to  detect  using  student  rating 
scores  when  faculty  members  are  less  enthusiastic  (low  in  seduction^ 
in  their  lecture  presentations.     Also,    they  reported  a  statistical  confir- 
mation (using  discriminant  function  analysis)  of  all  the  above  results, 
that  is  the  majority  of  error  in  detecting  differences  in  lecture  content 
is  a  result  of  bias   in  student  ratings  due  to  seductiveness  of  presentation. 

Williams  and  Ware  reported  two  efforts  in  attempting  to  "see 
through"  the  Doctor  Fox  effect.     In  the  first  (1976),    they  provided  stu- 
dents with  varying  amounts  of  monetary  incentive  for  learning  in  the 
lectures.      They  concluded  that  sensitizing  students  to  the  content  of  the 
lectures  did  not  improve  student  accuracy  in  the  rating  of  content  cover- 
age.    In  the  second  case  (1977),    they  tried  exposing  students  to  two  con- 
secutive lectures  of  the  same  type  in  content  coverage  and  seductiveness. 
They  found  that  accuracy  in  rating  of  content  coverage  did  not  improve 
when  stiidents  were  exposed  to  a  second  lecture  under  the  sam.e  condi- 
tions,   i.e.    providing  students  with  additional  exposure  to  the  lecturer 
does  not  enhance  the  students'  ability  to  "see  through'  the  Doctor  Fcx 
effect. 
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However,    throughout  all  the  above  studies,    one  result  remained 
constant.      Lecturer  expressiveness,    or  seduction,    has  a  major  impact 
on  student  ratings  of  instruction,    and  in  every  study  reported,    there 
was  a  significant  difference  in  the  rating  of  high  expressiveness  lectures 
as  opposed  to  low  expressiveness  lectures.      This  result  is  the  primary 
premise  of  the  Doctor  Fox  effect. 

Two  recent  studies  confirmed  this  primiary  premise  (Perry  et  al.  , 
19'''9;    Meier  and  Feldhusen,    in  press).     However,    Frey  (1979)  has 
questioned  these  results  by  contending  that  bias  in  student  ratings,    due 
to  this  primary  premise,    can  be  reduced  by  altering  student  ratings 
instruments  so  that  they  contain  more  items  geared  toward  learning 
outcomes.     Ware  and  Williams   (1979)  responded  to  this  criticism  by 
pointing  out  that  Frey's  criticism,    based  on  his  focus  that  specific  items 
relating  to  content  coverage  be  included  in  Doctor  Fox  research,    is  not 
valid.      They  pointed  out  specific  items  (knew  subject  matter  well, 
increased  student  knowledge  of  the  subject,    inspired  confidence  in 
knowledge  of  the  subject,    and  organized  and  presented  the  subject 
matter  well)  on  their  rating  instrument  which  show  Frey's  criticism  to 
be  in  error.      Further,    they  contended  that  their  results  and  the  results 
of  Meier  and  Feldhusen  (in  press)  showed  that  studencs  are  unable  to 
distinguish  content  level  under  varying  experimental  conditions.     Finally, 
they  reaffirmed  their  original  contention  that  the  Doctor  Fox  effect 
dealt  primarily  with  the  influence  of  expressiveness  on  sradent  ratings, 
and  that  content  recognition  by  students  was  a  secondary  issue. 
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From  the  above  review  of  the  Doctor  Fox  literature,    it  can  be 
seen  that,    to  date,    there  have  been  no  studies  providing  students  with 
an  opportunity  to  compare  immediately  lectures  varying  in  content  and 
in  expressiveness.      Thus,    by  designing  a  paired  lecture  comoarison 
study  of  lectures  varying  in  content  and  in  expressiveness,    an  additional 
testing  of  the  Doctor  Fox  effect,    both  the  influence  of  expressiveness  on 
student  ratings  and  the  masking  of  content  by  expressiveness,    is  pos- 
sible.    In  addition,    the  literature,    as  reviewed,    does  not  provide  any 
specific  experimental  information  as  to  what  are  the  high  expressive 
behaviors  of  the  Doctor  Fox  effect.     By  giving  students  an  opportunity 
to  select  adjectives,    characteristic  of  the  instructor,    that  are  descrip- 
tive of  a  better  lecture  presentation,    a  descriptive  analysis  of  the  high 
expressive  behaviors  is  possible.      Finally,    any  study  examining  student 
ratings  will  add  to  the  validity  literature,    particularly  a  study  examin- 
ing the  influence  of  lecturer  expressiveness  on  student  ratings. 


Chapter  III 
METHODOLOGY 

This  chapter  contains  a  restatement  of  the  questions  addressed  by 
this  study,    a  discussion  of  the  overall  experimental  design  with  attend- 
ant hypotheses,    a  specific  discussion  of  the  independent  variables  of 
content  and  of  expressiveness,    a  description  of  the  subjects  and  of  the 
research  instrumentation,    a  discussion  of  the  statistical  analyses  for 
this  study,    and  a  statement  of  the  limitations  of  the  study. 

Research  Questions  and  Hypotheses 
The  following  are  the  research  questions  addressed  by  this  studv, 

1.  Do  levels  of  lecturer  effectiveness  and  levels  of  lecture  con- 
tent interact  with  each  other  in  affecting  student  evaluation  of  lecturer 
effectiveness  ? 

2.  After  viewing  a  second  lecture  presentation  varying  in  content 
and/or  expressiveness  from  the  first  lecture  presentation,    do  levels  of 
content  and  expressiveness  of  this  second  lecture  interact  with  levels  of 
content  and  expressiveness  of  the  first  lecture  presentation  in  affecting 
the  student  evaluation  of  lecturer  effectiveness'?" 

3.  Are  there  differences  in  student  evaluations  of  lecturer 
effectiveness  for  lectures  which  are  high  in  expressiveness  as  opposed 
to  those  which  are  low  in  expressiveness? 
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4.  Does  the  level  of  content  in  a  lecture  presentation  affect 
student  evaluation  of  lecturer  effectiveness? 

5.  Are  there  differences  in  student  choices  of  adjectives, 
characteristic  of  the  instructor,    to  describe  what  they  feel  is  a  better 
lecture  presentation? 

As  a  result  of  the  above  research  questions,    the  following  major 
null  hypotheses  were  developed  to  be  tested  by  this  study. 
For  the  first  lecture  presentation  (Lecture  A), 

1.  There  will  be  no  differences  on  the  dependent  variables 
between  the  four  treatment  conditions,    two  levels  of  content  and  two 
levels  of  expressiveness.      (No  content  by  expressiveness  interaction.  ) 

2.  There  will  be  no  differences  on  the  dependent  variables 
between  the  two  conditions  of  content.      (No  main  effect  for  content.  ) 

3.  There  will  be  no  differences  on  the  dependent  variables 
between  the  two  conditions  of  expressiveness.      (No  main  effect  for 
expressiveness. ) 

For  the  second  lecture  presentation  (Lecture  B), 

1.  There  will  be  no  differences  on  the  dependent  variables 
bet'.veen  the  sixteen  treatment  conditions,    two  levels  of  content  and  two 
levels  of  expressiveness  for  Lecture  A  and  two  levels  of  content  and 
tv/o  levels  of  expressiveness  for  Lecture  B.      (No  content  (A)  by 
expressiveness  (A)  by  content  (B)  by  expressiveness  (B)  interaction.) 

2.  There  will  be  no  differences  on  the  dependent  variables 
between,  the  treatment  conditions  for  Lecture  A,    two  levels  of  content 
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and  two  levels  of  expressiveness,    and  thi?  treatment  conditions  for   Lec- 
ture B,    two  levels  of  content  and  two  levels  of  expressiveness. 

(a.     No  content(A)  by  expressiveness  (A)  by  content(B)  interaction. 

b.  No  content(A)  by  expressiveness(A)  by  expressiveness(B) 
interaction. 

c.  No  content(A)  by  content(B)  by  expressiveness(B)  interaction. 

d.  No  expressiveness(A)  by  content(B)  by  expressiveness(B) 
interaction. 

e.  No  content(A)  by  content(B)  interaction. 

f.  No  content(A)  by  expressiveness(B)  interaction. 

g.  No  expressiveness(A)  by  content(B)  interaction. 

h.     No  expressiveness(A)  by  expressiveness(B)  interaction.) 

3.  There  will  be  no  differences  on  the  dependent  variable  be- 
tween the  four  treatment  conditions  for  Lecture  A,    two  levels  of  content 
and  two  levels  of  expressiveness.      (No  content(A)  by  expressiveness(A) 
interaction,  ) 

4.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  content  for  Lecture  A.      (No  niain  effect 
for  contentfA).  ) 

5.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  expressiveness  for  Lecture  A.  (No  main 
effect  for  expressiveness(A).  ) 

b.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  four  treatment  conditions  for  Lecture  B,    two  levels  of  content 


and  two  levels  of  expressiveness.      (No  content(B)  by  expressivenessiB) 
interaction.  ) 

7.  There  will  be  no  differences  on  the  dependeni  variables  be- 
tween the  two  conditions  of  content  for  Lecture  B.      (No  main  effect  for 

content(B).  ) 

8,  There  will  be  no  differences  on  dependent  variables  be- 
tween the  two  conditions  of  expressiveness  for  Lecture  B.      (No  main 
effect  for  expressiveness(B).  ) 

Design  of  the  Study 
In  the  design  for  this  study,    students  were  presented  a  pair  of 
videotaped  lecture  presentations,    asked  to  rate  each  of  the  lecture  pre- 
sentations,   asked  to  choose  which  of  the  two  lecture  presentations  was 
the  better  presentation,    and  asked  to  select  those  adjectives  which 
were  influential  in  their  choice  of  which  of  the  two  lecture  presentations 
was  the  better  presentation.      The  various  components  of  the  data  to  be 
collected  from  this  procedure  gave  rise  to  various  design  considerations 
for  this   study. 

The  design  for  this  study  contains  two  separate  designs,  one  for 
the  first  lecture  presentation  and  one  for  the  second  lecture  presenta- 
tion. There  are  two  reasons  for  the  separate  designs  for  the  two  lec- 
ture presentations.  First,  the  research  questions  presented  above  can 
best  be  answered  by  this  separate  design  tactic.  Second,  the  first  lec- 
ture presentation  acts  as  a  treatment  precondition  for  the  second  lec- 
ture presentation,    thus  making  it  possible  to  see  if  there  is  an  effect 
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independent  variables. 

The  design  for  the  first  lecture  presentation  is  presented  in 
Figure  1.      This  is  a  2  x  Z  design  with  two  levels  of  content  (high  and  lov/) 
and  two  levels  of  expressiveness  (high  and  low).      This  design  is  a  repli- 
cation of  the  original  Doctor  Fox  study  (Ware,    1974)  without  the  nnediuin 
content  level.     A  specific  discussion  of  the  lecture  presentations  and  of 
the  independent  variables  of  content  and  expressiveness  is  found  in  the 
next  section  in  this  chapter. 

The  design  for  the  second  lecture  presentation  is  presented  in 
Figure  2.     This  is  aZx  2x2x2  design  with  two  levels  of  content  and 
two  levels  of  expressiveness  for  the  second  lecture  presentation,    as 
well  as  t\vo  levels  of  content  and  two  levels  of  expressiveness  corres- 
ponding to  the  first  lecture  presentation  and  acting  as  the  treatment  pre- 
conditions for  the  second  lecture  presentation. 

The  data  collection  for  these  designs  went  as  follows.      (Note:     see 
AppendLx  A  for  the  administration  directions  for  the  following  sequence.  ) 

The  first  lecture  was  presented  on  videotape  and  then  rated  by  the 
students.      The  second  lecture  was  presented  on  videotape  and  then  rated 
by  the  students.     Upon  completion  of  the  second  rating,    the  students 
were  asked  to  choose  which  of  the  lecture  presentations  was  better. 
After  making  the  choice,    they  were  asked  to  indicate  why  this  presenta- 
tion was  better  by  completing  a  checklist  of  teacher  behaviors  and 
characteristics.     Thus,    there  were  four  dependent  variables  in  this 
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design:     two  student  ratings  of  lectures;    a  choice  variable,    lecture  A 
or  lecture  B;    and  a  reason  variable,    consisting  of  the  choices  made  on 
the  checklist. 

The  Lectures 
The  lectures  used  in  this  study  are  the  original  Dr.    Fox  lectures 
as  used  by  Ware  (1974).     These  lectures  are  on  videotape  and  are  cop- 
ies of  the  original  lectures.     However,    instead  of  using  the  entire 
twenty  minute  videotaped  lecture  as  did  Ware,    only  the  first  five  min- 
utes of  a  given  lecture  were  used.      To  prevent  viewer  fatigue,    and  yet 
to  allow  enough  viewing  time  for  comparison,    the  sam.e  five  minute  seg- 
ment from  each  of  the  lectures  was  used. 

Each  lecture  segment  used  had  a  specific  level  of  content  and  a 
specific  level  of  expressiveness;    both  content  and  expressiveness  could 
be  either  high  or  low.     The  com.binations  of  content  levels  and  expres- 
siveness levels  produced  four  lecture  segments.     These  were,    including 
their  average  length  of  time  in  parentheses,    as  follows: 

High  content  -  High  expressiveness     (5  minutes,    6.45  seconds) 
High  content  -  Low  expressiveness      (5  minutes,    28.29  seconds) 
Low  content  -  High  expressiveness     (5  minutes,    8.  68  seconds) 
Low  content  -  Low  expressiveness      (5  munutes,    25.  66  seconds) 
These  lecture  segments  were  then  paired  together  in  all  possible 
combinations,    including  each  of  the  four  lectures  followed  by  itself,    and 
were  edited  together  on  the  videotape.     Each  lecture  segment  in  the  pair 
was  preceded  on  the  videotape  by  a  fifteen  second  segment  which 
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displayed  a  sign  on  the  screen  identifying  the  lecture  segment  as  either 

''Lecture  A"   or    'Lecture  B".      The  total  number  of  combinations  of  these 

four  lecture  segments  was   sixteen.      The  combinations  are  displayed 

below. 

Lecture  A  followed  by  Lecture  B 

1.  High  content-High  expressiveness     High  content-High  expressiveness 

Z.  High  content-Low  expressiveness     High  content-Low  expressiveness 

3.  Low  content-High  expressiveness     Low  content-High  expressiveness 

4.  Low  content-Low  expressiveness     Low  content-Low  expressiveness 

5.  High  content-High  expressiveness     High  content-Low  expressiveness 

6.  High  content-Low  expressiveness    High  content-High  expressiveness 

7.  Low  content-High  expressiveness     Low  content-Low  expressiveness 

8.  Low  content-Low  expressiveness     Low  content-High  expressiveness 

9.  High  content-High  expressiveness     Low  content-High  expressiveness 

10.  Low  content-High  expressiveness     High  content-High  expressiveness 

11.  High  content-Low  expressiveness     Low  content-Low  expressiveness 

12.  Low  content-Low  expressiveness     High  content-Low  expressiveness 

13.  High  content-High  expressiveness     Low  content-Low  expressiveness 

14.  Low  content-Low  expressiveness     High  content-High  expressiveness 

15.  High  content-Low  expressiveness     Low  content-High  expressiveness 

16.  Low  content-fiigh  expressiveness     High  content-Low  expressiveness 
It  should  be  noted  that  the  above  combinations  also  take  into  account  that 
the  order  of  presentation  of  the  lecture  segments  must  be  controlled  for, 
and  thus  each  pair  of  lecture  segments  has  its  reversed  order  pair 
directly  following  it  in  the  list,    beginning  with  pair  number  5  and  6. 


Videotaped  lecture  segirients  were  used  for  several  reasons. 
First,    this  procedure  allowed  for  the  control  of  the  various,    essential 
conditions  and  treatment  levels  in  the  experimental  design.     Second,    the 
original  Doctor  Fox  studies  were  done  with  videotapes,    and  any  replica- 
tion of  the  Doctor  Fox  effect  would  be  biased  if  videotape  were  not  used. 
In  addition,    the  use  of  the  original  tapes  from  the  Doctor  Fox  studies 
made  it  possible  for  implications  from  any  replication  of  the  Doctor  Fox 
effect.      Third,    it  is  difficult  to  control  a  live  presentation.      No  amount 
of  rehearsal  and  practice  can  guarantee  the  same  qualities  in  the  pre- 
sentations every  time.     Thus,    the  videotape  was  used  for  control  of 
unwanted  variability. 
The  Content  Dimension 

The  content  dimension  was  defined  by  Ware  (1974)  as  containing 
a  specified  number  of  teaching  points  for  the  conditions  of  the  content 
dimension.     A  high  content  lecture  contained  (if  the  entire  lecture  were 
used)  Z6  teaching  points.     In  this  study  the  high  content  lecture  segment 
contained  6  teaching  points.      The  low  content  lecture  contained  (if  the 
entire  lecture  were  used)  4  teaching  points.     In  this  study  the  low  con- 
tent lecture  segment  contained  0  teaching  points. 

Verbatim,  scripts  for  the  high  content  and  low  content  lectures  can 
be  found  in  Appendices  B  and  C,    respectively.     The  six  teaching  points 
for  the  high  content  lecture  are  underlined  in  Appendix  B. 
The  Expressiveness  Dimension 

Expressiveness  was  defined  by  Ware  (1974)  as  follows: 

...    a  number  of  different  terms  have  been  used, 
all  of  which  appear  to  refer  to  the  seduction- 
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expressiveness  aspect  of  teaching  effectiveness, 
including:     "charisma",    "dynamism.'',    "emotional 
appeal",    "friendliness",    "interest",    "personality", 
"seduction",    "stimulation",    and  "warmth".     Seduction- 
expressiveness  is  operationally  defined  as  the 
extent  to  which  these  mannerisms  are  present  in  the 
lecture  presentation,      (p.    4) 

Thus,    the  high  expressive  lecture  contained  all  or  m.ost  of  the  elements 

of  the  above  definition  of  expressiveness.      The  low  expressive  lecture 

contained  few,    if  any,    of  the  above  elements. 

Note  that  in  Appendices  B  and  C  that  there  are  phrases  in  the 

lecture  texts  which  are  in  parentheses.      These  phrases  are  omitted 

from  the  low  expressive  lectures  for  the  respective  content  levels.     In 

addition  to  the  above  information  on  the  expressiveness  dimension, 

Ware  (1974,    pp.    61   -  64)  gives  a  detailed  description  of  the  training  of 

the  actor  to  display  the  expressiveness  elements  cited  above. 

Subjects 
The  subjects  for  this  study  were  obtained  from  those  students 
registered  in  undergraduate  courses  of  the  Foundations  of  Education 
Departm-ent  at  the  University  of  Florida.      The  undergraduate  courses 
were  Huxnan  Gro\vth  and  Development  (8  sections),    Social  Foundations 
of  Education  (4  sections).    Educational  Psychology  (2  sections),    and 
History  o'l  Education  in  the  United  States   (2  sections).      Each  of  the  six- 
teen classes  was  randomly  assigned  to  one  of  the  sixteen  lecture  pairs 
stared  above.      Thus,    this  was  a  random  assignment  of  intact  classes. 
Individual  assignment  for  randomization  was  not  done  and  therefore 
certain  precautions  must  be  taken  before  conducting  the  analyses  of 
the  data. 
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These  precautions  are  to  insure  that  the  partitioning  of  the  be- 
tween groups  variance  is  not  confounded  by  the  classes  nested  within 
treatments.     If  the  variance  attributable  to  these  nested  classes  is  large 
enough  to  be  significant  when  tested  against  the  variance  for  the  subjects 
within  the  groups,    the  interpretation  of  results  will  be  confounded. 
This  can  be  tested  by  conducting  a  2  x  Z  analysis  of  variance  with  the 
classes  nested  for  Lecture  A.     This  was  done  and  an  F  value  of  .  78 
at  IZ  and  26Z  degrees  of  freedom  was  obtained.      This  value  is  not  sig- 
nificant and  the  classes  nested  within  groups  does  not  need  to  be  parti- 
tioned out  of  the  total  variance  for  the  miodel  tested  in  the  Lecture  A 
analysis. 

In  all  there  were  278  subjects  in  this  study  with  a  mean  age  of 
21.  4  years.      The  median  age  was   19.  B  years.     Of  the  Z78  subjects, 
83.  8%  were  females  and  16.  Z%  were  males;    their  median  grade  point 
average  was  the  equivalent  of  a  B  +  .      Juniors  comprised  54.7%  of  the 
samiple;    seniors,    Z5.  Z%  of  the  sample;    and  sophomores,    17.  3%  of  the 
sample. 

The  primary  colleges  of  registration  in  the  sample  were  Educa- 
tion (32.4%),    University  College  (28.8%),   Arts  and  Sciences   (14.7%), 
and  Physical  Education  (13.  3%), 

The  principal  academic  majors  of  the  sample  were  as  follows; 
Elementary  education  (14.7%),    nursing  (11.2%),    speech  pathology 
(10.1%),    physical  education  (7.9%),    and  special  education  (7.2%).     A 
more  detailed  breakdown  of  these  data  is  presented  in  Table  1. 
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Table  1 


Sample  Population  Frequency  Distributions  for  Age,  Sex, 
Grade  Point  Average,  Year  in  College,  College  of  Regis- 
tration,   and  Academic  Major 


Frequency 

Cum  Freq 

Percent 

Cum  Percent 

Age 

Age 

18 

13 

13 

4.  676 

4.676 

19 

43 

56 

15.468 

20.  144 

20 

99 

155 

35.  612 

55.755 

21 

61 

216 

21.  942 

77. 698 

22 

23 

239 

8.273 

85.  971 

23 

8 

247 

2.878 

88.849 

24 

2 

249 

0.719 

89.  568 

25 

7 

256 

2.  518 

92. 086 

26 

3 

259 

1.079 

93.165 

27 

2 

261 

0.719 

93.885 

28 

2 

263 

0.719 

94.  604 

29 

2 

265 

0.719 

95.324 

30 

2 

267 

0.719 

96.  043 

31 

2 

269 

0.719 

96.763 

32 

1 

270 

0.  360 

97. 122 

33 

1 

271 

0.360 

97.432 

34 

2 

273 

0.719 

98.201 

35 

1 

274 

0.  360 

98. 561 

40 

2 

276 

0.  719 

99.281 

53 

1 

277 

0.  360 

99.  640 

55 

1 

278 

0.360 

100.  000 

Sex 

Sex 

Female 

233 

233 

83. 813 

S3.  813 

Male 

45 

278 

16,  187 

100,  000 
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F: 

requency    Cum  Freq 

Percent 

Cum  Percent 

Grade  Point 

Average 

GPA 

3.  6  -  4.  0 

34 

34 

12,230 

12.230 

3.  1   -  3.  5 

98 

132 

35.252 

47. 482 

2.  6  -  3.  0 

99 

231 

35.612 

83.  094 

2.  1   -  2.  5 

44 

275 

15.827 

98. 921 

1.  0  -  2.  0 

3 

278 

1.  079 

100. 000 

Year  In  C< 

ollege 

Year 

Freshrnan 

1 

1 

0.  360 

0.  360 

Sophomore 

48 

49 

17.266 

17. 626 

Junior 

152 

201 

54.676 

72. 302 

Senior 

70 

271 

25.  180 

97.482 

Post  Graduate 

7 

278 

2.  518 

100. 000 

College  of  Rej 

^istration 

College 

Agriculture 

6 

6 

2.  158 

2.  158 

Architecture  k 

8 

14 

2.878 

5.  036 

Fine  Arts 

Arts  &  Sciences 

41 

55 

14.748 

19.784 

Business  Adniin. 

2 

57 

0.719 

20.  504 

Education 

90 

147 

32.374 

52.878 

Health  Related 

2 

149 

0.719 

53. 597 

Professions 

Journalism 

5 

154 

1.799 

55.  396 

Physical  Educ. 

37 

191 

13.309 

68. 705 

University  Col. 

80 

271 

28.777 

97.482 

Undecided  or 

7 

278 

2.  518 

100. 000 

unknown 
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Frequency 

Cum  Freq 

Percent 

Cum.  Percent 

Academic 

Major 

Major 

Early  Childhood 

6 

6 

2.  158 

2.  158 

Education 

Elementary  Edu- 

41 

47 

14.748 

16.906 

cation 

Foundations 

3 

50 

1.  079 

17.  986 

Secondary  Educ. 

ZO 

70 

7.  194 

25.  180 

Special  Educ. 

24 

94 

8.  633 

33.  813 

English 

5 

99 

1.799 

35.  612 

Nursing 

31 

130 

11. 151 

46.763 

History 

3 

133 

1.  079 

47.842 

Mathematics 

4 

137 

1.439 

49.281 

Art  Education 

7 

144 

2.  518 

51.799 

Music  Education 

5 

149 

1.799 

53. 598 

Psychology 

10 

159 

3.  597 

57. 195 

Speech  Pathology 

28 

187 

10.  072 

67.267 

Agricultural  Ex- 

4 

191 

1.439 

68.706 

tension  Educ. 

Physical  Educ. 

22 

213 

7.914 

76.  620 

Recreation 

15 

228 

5.  396 

82.016 

Health  Educ. 

10 

238 

3.  597 

85.  613 

Other 

29 

267 

10.430 

96.  043 

Unknown  or 

11 

278 

3.  957 

100. 000 

Undecided 

By  way  of  comparison,    the  original  sample  of  the  Doctor  Fox 
studies  (Ware,    1974;    Ware  and  Williams,    1975)  contained  207  students. 
That  sample  contained  67%  females  and  33%  males.      The  median  age 
was  19,9,     There  were  21%  freshmen,    30%  sophomores,    28%  juniors, 
18%  seniors,    and  3%  graduate  students.      The  primary  colleges  of  reg- 
istration of  the  students  were  liberal  arts  and  sciences  (42%),    education 
(11%),    engineering  (11%),    and  business  (7%),     Thus,    the  present  study 
has,    in  comparison,    a  higher  percentage  of  females,    of  upper  classmen, 
and  of  individuals  registered  in  the  college  of  education.     Other  than 
these,    the  samples  are  comparable.     Research  reviews  of  student 
characteristics  and  student  ratings  (Rosenshine  and  Furst,    1971; 
Cohen  et  al.  ,    1973)  showed  that  any  differences  in  student  ratings  due 
to  student  characteristics  were  produced  by  undergraduate  versus  grad- 
uate student  ratings.      The  t-A^o  samples  discussed  here  have  a  similar 
percentage  of  graduate  students.     There  were  no  differences,    found  in 
the  reviews,    attributed  to  the  other  characteristics  used  to  describe 
the  sample  of  the  present  study. 

Instrumentation 
The  data  collected  in  this   study  were  student  ratings  of  two  lec- 
ture presentations,    a  choice  of  which  of  the  two  presentations  was  the 
better  presentation,    and  a  list  of  adjectives  describing  the  lecture  each 
student  chose  as  the  better  lecture.      The  data  were  collected  in  a  lec- 
ture evaluation  booklet.     T?iis  booklet  is  presented  in  AppendLx  D.      The 
booklet  in  Appendix  D  contains  the  student  rating  instrum.ent,    the 
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lecture  choice  instrument,    and  the  adjective  checklist.      These  are 
discussed  separately  below. 
The  Student  Rating  Instrviment 

The  student  rating  instrument  is  the  same  instrument  used  in  the 
original  Doctor  Fox  studies  (Ware,    1974),      It  is  a  modified  student 
evaluation  instrument  as  developed  by  Pohlm.an  (197  5),    with  an  internal 
consistency  of  total  score  rating  of  .  96,   using  the  KR-20  formula. 
This  rating  instrument,    adapted  by  the  original  Doctor  Fox  researchers 
from-  a  pre-existing  instrument,    is  designed  to  measure  the  character- 
istics of  the  expressiveness  and  content  dimensions  of  the  Doctor  Fox 
effect. 

The  reliability  analysis  for  the  student  rating  instrument  for  this 
study  is  presented  in  Table  2.      The  total  reliability  presented  is  a 
pooled  KE.-ZO  reliability  across  treatment  groups.     This  pooling  is 
done  to  avoid  the  between  group  differences,    caused  by  any  treatment 
effect,    which  might  affect  the  reliability  of  the  instrvunent.      The  reli- 
ability analysis  for  this  study  was  done  using  the  Statistical  Package 
for  the  Social  Sciences  (SPSS)  (Nie  and  Hull,    1977). 

The  pooled  reliability  for  the  student  rating  instrument  on  the 
Lecture  A  presentation  is  .  9425.      The  pooled  reliability  for  the  student 
rating  instrument  on  the  Lecture  B  presentation  is  .  9530.      These  reli- 
abilities are  relatively  high,    and  account  for  89%  and  91%  of  the  vari- 
ance in  the  total  rating  scores  on  the  student  rating  instrument.     These 
corn-pare  favorably  with  what  is  reported  by  Ware  (1974);    a  reliability 
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Table  Z 


Student  Rating  Instrument  IvR-ZO  Reliability  for 
Indi\ddual  Treatment  Groups 


Treatment 

ss 

df 

SS 

df 

r^ 

Group 

between  subjects 

residual 

Lecture 

A 

1 

Z19.  6144 

16 

119.  0915 

272 

.9681 

2 

173.0377 

27 

250.  4270 

459 

.  9149 

3 

80.  1482 

11 

75.  1852 

187 

.9456 

4 

94. 6667 

12 

110.7179 

204 

.  9312 

5 

108. 1241 

16 

138. 8170 

272 

.  9245 

6 

93.2353 

16 

157. 0000 

272 

.  9010 

7 

219.  6078 

16 

155. 8039 

272 

.  9583 

8 

116. 5238 

13 

109.4762 

221 

.  9447 

9 

302.9924 

21 

231,8712 

357 

.  9550 

10 

127. 5000 

15 

174.2500 

255 

.9196 

11 

70. 1354 

15 

142. 3021 

255 

.8807 

12 

136. 9889 

19 

147. 6111 

323 

.9366 

13 

103.  1620 

11 

98. 9213 

187 

.  9436 

14 

81.0404 

10 

73. 8687 

170 

.9464 

15 

239. 6732 

16 

167. 5033 

272 

.  9589 

16 

255.  0690 

28 

213.  1379 

47  6 

.  9509 

otal       2421.5193 

262 

2365.9843 

4454 

. 942  5^ 

Table  2    (Cont'd. 


Treatment     SS 

df 

SS 

df 

r^ 

Group               between  subjec 

ts 

residual 

Lecture 

B 

1 

136.2483 

16 

111.9869 

272 

.  9517 

2 

204,2282 

27 

225.8790 

459 

.9349 

3 

102.  nil 

11 

66. 3889 

187 

.  9618 

4 

137.8291 

12 

102. 3248 

204 

.  9563 

5 

172.3856 

16 

119. 1438 

272 

.9593 

6 

87.9020 

16 

92.8039 

272 

.9379 

7 

115.7190 

16 

126. 7516 

272 

.  9356 

8 

105.0794 

13 

99. 3492 

221 

.  9444 

9 

265.7702 

21 

184. 6389 

357 

.9591 

10 

103.7743 

15 

105.  9132 

255 

.  9400 

11 

135.7222 

15 

117. 7778 

255 

.  9490 

12 

229.7194 

19 

135.  0306 

323 

.  9654 

13 

81.4444 

11 

90. 8889 

187 

.  9344 

14 

115.  6465 

10 

55.  2626 

170 

.9719 

15 

149.  8039 

16 

135.  9608 

272 

.  9466 

16 

308.4023 

28 

188. 14Q4 

476 

.9641 

Total 

2451.7859 

262 

1958. 2503 

4454 

.9530'' 

^KR-20 

v  = . 

8883 

^r2  =  . 

9082 

of  .  96  which  accounted  for  9Z%  of  the  variance  in  the  total  rating 
scores  on  the  same  instrument. 
The  Lecture  Choice  Instrument 

The  lecture  choice  instrument  is  a  simple,    dichotonaous  forced 
choice  question.      The  students  were  asked  to  select  which  of  the  two 
lecture  presentations  they  saw  was  the  better  presentation.      They  were 
asked  to  check  a  box  corresponding  to  Lecture  A  or  a  box  corresponding 
to  Lecture  B.      They  were  asked  to  choose  only  one  of  the  two  lectures. 
Of  the  278  subjects,    277  responded  as  directed  to  this  question.      The 
analysis  of  this  question  is  presented  in  Chapter  4. 
The  Lecturer  Adiective  Checklist 

The  lecturer  adjective  checklist  consists  of  forty-seven  adjec- 
tives.     These  adjectives  are  drawn  from  the  literature  on  character- 
istics of  effective  teachers  (Bridges,    et  al.  ,    1971;    Hildebrand  et  al.  , 
1971;    and  Wotruba  and  Wright,    1975). 

The  characteristics  identified  were  compiled  into  one  list  and 
all  multiple  word  descriptions  were  reduced  to  single  word  adjectives. 
This  list  was  then  compared  to  the  descriptions  in  Ware  (1974,    pp.    4, 
16-18,    and  62-63)  of  the  expressive  or  seductive  lecturer.     All  adjec- 
tives which  were  not  in  the  Ware  sources  were  rejected  as  inappropri- 
ate.     The  remaining  adjectives  were  then  given  a  random  order  and 
the  checklist  was  complete. 

The  intent  of  comparing  these  effective  teacher  characteristics, 
identified  in  various  sources,    with  those  of  Ware  was  to  identify  the 
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teaching  behaviors  associated  with  the  Doctor  Fox  effect.      This  was 
done  in  the  desire  to  expand  the  information  on  the  teaching  behaviors 
in  the  Doctor  Fox  effect. 

Table  3  presents  the  adjective  checklist  and  its   sources,    both 
from  the  literature  and  from  Ware.     It  should  be  noted  that  one  adjec- 
tive,   seductive,    recei-^'ed  no  choices  in  the  study  and  v/ill  not  be  discus- 
sed hereafter. 

Statistical  Analyses 

The  statistical  analyses  for  this  study  are  presented  in  this  sec- 
tion.     First,    there  is  a  consideration  of  the  analyses  appropriate  for 
the  hypotheses  related  to  Lecture  A.     Second,   the  analyses  appropri- 
ate for  the  hypotheses  related  to  Lecture  B  are  discussed.     Thirdly, 
there  is  a  brief  discussion  of  the  analyses  appropriate  for  the  lecture 
choice  variable.      Fourthly,    the  analyses  appropriate  for  the  adjective 
checklist  are  presented.     It  should  be  noted  that  all  statistical  analyses 
were  done  with  the  Statistical  Analysis  System  (SAS)  (Barr  et  al.  , 
1976). 
The  Lecture  A  Analyses 

The  design  and  hypotheses  for  Lecture  A  require  that  the  analysis 
be  in  the  form  of  a  factorial  analysis  of  variance.      However,    because 
the  number  of  subjects  per  cell  was  not  equal  and  because  this  \inequal 
n  was  the  result  of  natural  groups  of  unequal  size,    an  unweighted 
means  solution  is  appropriate  to  analyze  the  data.      (Timm  and  Carlson, 
1975). 
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Table  3 
The  Lecturer  Adjective  Checklist  and  its  Sources 


Adjective              W 

are  (1974)- 

Bridges  et  al. 
(1'371) 

Hildebrand 
et  al.    (19711 

Wotruba  and 
Wright  (197  5) 

Dramatic 

LC 

Knowledgeable 

C 

X 

X 

X 

Thorough 

D 

X 

Coherent 

D 

X 

X 

Well-prepared 

D 

X 

X 

Energetic 

T 

X 

Logical 

C 

X 

Explanatory 

D 

X 

Inspiring 

LC 

Understandable 

D 

X 

X 

Well-paced 

D 

X 

Expressive 

LC 

X 

Forceful 

LC 

X 

Interesting 

LC 

X 

X 

Variety 

L 

X 

X 

Stimulating 

L 

X 

Interested 

LC 

X 

X 

X 

Warm 

LC 

Scholarly 

C 

X 

Orderly 

C 

X 

X 

40 


Table  3  (Cont'd. 


Adjective  Ware  (1974)*      Bridges  et  al.    Hildebrand        Wctruba  and 

(1971)  et  al.    (1971)     Wright  (1975) 


Stylized  LC  X 


Motivating 

LC 

X 

X 

Masterf\il 

D 

X 

Enthusiastic 

LC 

X 

X 

X 

Showmanship 

LC 

X 

Vital 

LC 

X 

Concise 

D 

X 

Lucid 

D 

X 

Enjoyable 

C 

X 

X 

Clear 

D 

X 

X 

X 

Inventive 

LC 

X 

Cultured 

C 

X 

Confident 

c 

X 

X 

Poised 

c 

X 

Humorous 

c 

X 

X 

X 

Sparkling 

LC 

X 

Competent 

C 

X 

X 

Charismatic 

LC 

Conscientious 

D 

X 

Dynamic 

LC 

X 
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Table  3  (Cont'd.  ) 


Adjective 

W 

are  (1974)* 

B 

ridges  ez 
(1971) 

al. 

Hildebrand 
et  al.    (1971) 

Wotruba  and 
Wright  (1975) 

Well-groomed 

C 

X 

X 

Organized 

c 

X 

X 

X 

Careful 

D 

X 

Witty 

C 

X 

X 

Unique 

LC 

X 

Persuasive 

LC 

X 

■•'   In  the  column  for  Ware,    the  L  refers  to  his  list  on  page  4,    the  C 
refers  to  his  chart  on  pages   16-18,    and  the  D  refers  to  his 
descriptions  on  pages  62-63. 
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The  variance  for  the  between  groups  is  partitioned  for  the  content 
main  effect,    the  expressiveness  main  effect,    and  for  the  content/expres- 
siveness  interaction.     Should  there  be  a  significant  interaction,    the 
between  groups  variance  must  be  repartitioned  for  simple  main  effects 
of  content  at  both  levels  of  expressiveness  and  expressiveness  at  both 
levels  of  content.      This  analysis  provides  answers  to  the  following  three 
null  hypotheses: 

1.  For  the  first  lecture  presentation  (Lecture  A),    there  will  be 
no  differences  on  the  dependent  variables  between  the  four  treatment 
conditions,    two  levels  of  content  and  two  levels  of  expressiveness, 

2.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  content. 

3.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  expressiveness. 

The  Lecture  B  Analyses 

The  Lecture  B  analyses  are  similar  to  those  for  Lecture  A.      The 
unweighted  means  solution  is  the  appropriate  analytical  method  to  be 
employed.      The  analysis  is  more  com.plicated  because  the  design  con- 
tains four  independent  variables,    content  and  expressiveness  for  Lec- 
ture A,    and  content  and  expressiveness  for  Lecture  B.      The  partition- 
ing of  the  variance  is  complicated  by  the  number  of  possible  interac- 
tions between  the  four  independent  variables.     However,    any  significant 
interactions  call  for  a  repartitioning  of  the  variance  for  the  variables 
involved  in  that  interaction.      The  approach  to  this  partitioning  remains 
the  same  as  that  used  for  Lecture  A. 
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This  analysis  provides  answers  to  the  following  null  hypotheses: 

1.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  sixteen  treatment  conditions,    t'vvo  levels  of  content  and  two 
levels  of  expressiveness  for  Lecture  A  and  two  levels  of  content  and 
two  levels  of  expressiveness  for  Lecture  B. 

2.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  treatment  conditions  for  Lecture  A,    two  levels  of  content  and 
two  levels  of  expressiveness,    and  the  treatment  conditions  for  Lecture 
B,    two  levels  of  content  and  two  levels  of  expressiveness. 

3.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  treatment  conditions  for  Lecture  A,    two  levels  of  content  and 
two  levels  of  expressiveness. 

4.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  content  for  Lecture  A. 

5.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  expressiveness  for  Lecture  A. 

6.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  four  treatment  conditions  for  Lecture  B,    two  levels  of  content 
and  two  levels  of  expressiveness. 

7.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  content  for  Lecture  B. 

8.  There  will  be  no  differences  on  the  dependent  variables  for 
the  two  conditions  of  expressiveness  for  Lecture  B. 
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The  Lecture  Choice  Variable  Analysis 

The  lecture  choice  variable  is  a  dichotomous  variable  involving 
the  choice  of  either  Lecture  A  or  Lecture  B  as  the  better  lecture.      There 
are  two  types  of  analyses  that  are  performed  on  this  data. 

The  first  analysis  is  to  compare  the  lecture  choice  selection  of 
each  subject  with  the  lecture  that  each  subject  rated  higher.      This  is 
done  by  using  a  Spearman  rank  order  correlation  coefficient.     This 
reveals  the  relationship  between  the  lecture  choice  and  the  higher  rated 
lecture.     It  also  provides  insight  into  the  accuracy  of  the  subjects' 
lecture  choice  versus  the  rating  choice. 

The  second  analysis  appropriate  for  this  data  is  a  chi-square 
analysis  which  would  look  at  the  research  hypotheses  on  content  main 
effects  and  expressiveness  main  effects.     This  analysis  furthers  the 
information  on  content  and  expressiveness  main  effects  obtained  from 
the  analyses  of  the  student  rating  instrvunents. 
The  Adjective  Checklist  Analysis 

The  statistical  analysis  appropriate  for  the  adjective  checklist  is 
chi-square  analysis.  The  data  are  sorted  on  which  lecture  the  subject 
chose  as  the  better  lecture  and  then  a  chi-square  analysis  is  conducted 
on  each  adjective  for  the  lecture  chosen.  A  chi-square  that  is  not  sig- 
nificant would  mean  that  the  frequency  of  choice  of  a  particular  adjec- 
tive is  random-  and  is  not  affected  by  the  various  combinations  of  con- 
tent level  and  expressiveness  level. 
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An  additional  note  on  the  analysis  of  the  lecture  choice  variable 
and  adjective  checklist  is  appropriate  here.     In  addition  to  the  analyses 
nnention  for  both,    analyses  of  the  rating  choice  variable  (which  lecture 
was  rated  higher)  are  performed.     These  analyses  are  identical  to 
those  performed  with  the  lecture  choice  variable  and  the  adjective  check- 
list.     These  analyses  provide  additional  information  on  the  validity  of 
the  lecture  choice  variable  and  the  adjective  checldist. 

Limitations  of  the  Study 

1.  The  interaction  of  Dr.    Fox  with  the  sample  is  limited. 
Because  his  expressiveness  is  a  fixed  quality  (on  videotape),   he  has 
no  way  of  interacting  with  the  sample  classes. 

2.  The  dependent  measures  (the  student  rating  instrument  and 
the  choice/checklist  instrument)  are  not  pretested  in  this  population. 
Therefore,    reliability  and  validity  are  not  previously  established 
(although  the  rating  instrument  does  have  these  measures  from  the 
previous  Doctor  Fox  studies). 

3.  The  generalizability  from  this   sample  to  a  larger  population 
is  hampered  by  the  above  factors. 

4.  The  generalizability  of  the  results  of  this  study  is  limited 
to  lecturing  behaviors  of  college  teachers. 


Chapter  IV 
RESULTS 

In  this  chapter,    a  presentation  of  the  results  of  this   study  is  made. 
First,    there  is  a  presentation  of  the  results  of  the  analyses  for  Lecture 
A.     Second,    the  Lecture  B  analyses  will  be  presented.      Third,    there  is 
a  consideration  of  the  results  of  the  analyses  related  to  the  lecture 
choice  variable.      Fourth,    the  adjective  checklist  analyses  are  reported. 

The  Lecture  A  Analysis  Results 
The  analyses  for  Lecture  A  are  presented  in  Table  3.     These 
results  are  discussed  below  in  the  order  that  the  statistical  hypotheses 
were  presented  in  Chapter  3. 

1.      There  will  be  no  differences  on  the  dependent  variables  (in 
this  case,    the  student  rating  instrument  total  score)  between  the  four 
treatment  conditions,    two  levels  of  content  and  two  levels  of  expressive- 
ness.     (No  content  by  expressiveness  interaction.  )    As  can  be  seen  in 
Table  3,    the  overall  between  groups  sum  of  squares  has  a  significant  F_ 
ratio  at  the  .  05  level  (F_  -  ZZ.  80  for  3  and  Z74  degrees  of  freedom).     In 
addition,    the  _F  ratio  for  the  content  by  expressiveness  interaction  is 
also  significant  at  the  ,  05  level  (F_  =  6.71  for  1   and  Z74  degrees  of 
freedom).     Because  of  the  two  results  above,    the  first  null  hypothesis 
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Table  3 

2x2  Analysis  of  Variance  for  Student  Rating  Instrument 
Total  Score  on  Lecture  A 


Source 

df 

Sum  cf  Squares 

Mean  Square 

F 

Anova  for  2x2  Desig 

;n 

Between  Groups 

3 

11268. 0675 

3756.  0225 

22. 

80* 

(Model) 

Content 

1 

904. 9677 

904. 9677 

5. 

49** 

Expressive- 

1 

8778. 2679 

8778. 2679 

53. 

23** 

ness 

Content  x  Ex- 

1 

1104. 8126 

1104.8126 

6, 

71** 

pressiveness 

Within  Groups           274 

45142.4829 

164.7536 

(Error) 

Total       277 

56410. 5504 

Simple  Main  Effects 

Expressiveness 

1 

9234.2145 

9234.  2145 

56. 

05*** 

at  High  Content 

Expressiveness 

1 

1620. 5162 

1620.  5162 

9. 

73*** 

at  Low  Content 

Content  at  High 

1 

1924.  0999 

1924,  0999 

11. 

Q  W  '1*  I-  'T^ 

Expressiveness 

Content  at  Low 

1 

5.  1983 

5.  1938 

, 

03 

Expressiveness 

*   (p<.05,    F(3^274,  .05)  =  ^-  ^4) 

**   (p<.05.    F,i^274,.05)  =  3-88) 

***    (p<.01.    F,i,274,  .01)  -  6.74) 
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is  rejected  and  instead,    the  alternative  hypothesis  that  there  are  differ- 
ences on  the  dependent  variables  for  the  four  treatment  conditions  is 
accepted. 

However,    these  results  require  that  to  examine  the  remaining  two 
hypotheses,    a  simple  main  effects  analysis  must  be  conducted  on  the 
data  (Kirk,    1968).      This  was  done  and  the  results  are  reported  in 
Table  3. 

2.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  content.      (No  main  effect  for  content.  )     To 
examine  this  hypothesis,    content  must  be  analyzed  at  both  levels  of 
expressiveness.      This  was  done.     When  expressiveness  was  high,    the 
content  dimiension  produced  a  significant  _F  ratio  at  the  .  01  level  (F  = 
11.  69  for  1   and  274  degrees  of  freedom).     When  expressiveness  was  . 
low,    the  content  dimension  did  not  produce  a  significant  F  ratio.     Thus 
the  null  hypothesis  for  content  is  partially  accepted  and  partially  rejec- 
ted.     The  hypothesis  is  accepted  when  content  is  examined  at  a  low 
expressiveness  level.      The  hypothesis  is  rejected  when  content  is  exam- 
ined at  a  high  level  of  expressiveness,    and  the  alternative  hypothesis, 
that  there  are  differences  on  the  dependent  variable  for  the  conditions 

of  content  when  expressiveness  is  high,    is  accepted. 

3.  There  will  be  no  differences  on  the  dependent  variables  be- 
tAveen  the  two  conditions  of  expressiveness.      (No  main  effect  for  expres- 
siveness. )     To  examine  this  hypothesis,    expressiveness  n-iust  be  ana- 
lyzed at  both  levels  of  content.      This  was  done.     When  content  was  high. 
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the  expressiveness  dimension  produced  a  significant  F  ratio  at  the  .  01 
level  (F  =  56.  05  for  1   and  274  degrees  of  freedom).     When  content  was 
low,    the  expressiveness  dimension  produced  a  significant  F_  ratio  at  the 
.  01  level  (F  =  9.  73  for  1  and  274  degrees  of  freedom).      Thus  the  null 
hypothesis  for  expressiveness  is  rejected  completely  and  the  alterna- 
tive hypothesis,    that  there  are  differences  on  the  dependent  variables 
for  the  tv/o  conditions  of  expressiveness,    is  accepted. 

Table  4  presents  the  rating  instrument  tneans  for  the  four  treat- 
ment conditions  for  Lecture  A.      Figures  3a  and  3b  portra/  graphically 
the  results  mentioned  above.     Figure  3a  shows  that  there  is  a  difference 
between  the  means  for  the  high  expressiveness  groups  of  the  content 
dimension,   while  there  is  very  little,    if  any,    difference  between  the  low 
expressiveness  groups  for  the  content  dimension.     Figure  3b  shows  the 
differences  between  the  means  for  both  content  levels  for  the  expres- 
siveness dimension. 

Summarizing  the  results  for  the  Lecture  A  analyses,    there  are 
significant  differences  between  high  expressiveness  and  low  expressive- 
ness for  both  content  levels,    and  there  is  a  significant  difference  be- 
tween the  content  groups  if  the  expressiveness  was  high. 

The  Lecture  B  Analyses  Results 
The  analyses  for  Lecture  B  are  presented  in  Tables   5  and  6. 
These  results  are  discussed  below  in  the  order  that  the  statistical 
hypotheses  were  presented  in  Chapter  3. 
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Table  4 


Student  Rating  Instrument  Mean  Scores  for 
Lecture  A  Treatment  Groups 


N 


Mean 


Standard 
Deviation 


High  Content 

High  Expressiveness 
Low  Expressiveness 

Low  Content 

High  Expressiveness 
Low  Expressiveness 


68 

56. 5735 

14.2466 

90 

41.1333 

11.0293 

62 

48.8710 

14.  1160 

58 

41.  5172 

12.2564 

Mean 

Rating 

Scores 


60 
55 
50 
45 
40 


Low  Content 
High  Content 


High  Low 

Expressiveness  Groups 


Figure  3a 
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Mean 

Rating 

Scores 


60 
55 
50 

45 
40 


High  Content 
—  Low  Content 


High 


i_,ow 


Content  Groups 


Figure  3b 
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1.  There  will  be  no  differences  on  the  dependent  variables   (in 
this  case,    the  student  rating  instrument  total  score)  between  the  sixteen 
treatment  conditions,    two  levels  of  content  and  two  levels  of  expressive- 
ness for  Lecture  A  and  two  levels  of  content  and  two  levels  of  expres- 
siveness for  Lecture  B.      (No  content  (A)  by  expressiveness   (A)  by  con- 
tent (B)  by  expressiveness   (B)  interaction.  )    As  can  be  seen  in  Table  5, 
the  overall  between  groups  sum  of  squares  has  a  significant  F  ratio  at 
the  .  05  level  (F^  =  11.  25  for  15  and  262  degrees  of  freedom).      In  addition, 
the  F_  ratio  for  the  content  (A)  by  expressiveness   (A)  by  content  (B)  by 
expressiveness  (B)  is  not  significant  at  the  .  05  level  (F  =  2,  13  for  1  and 
262  degrees  of  freedom).     Because  of  the  second  result  above,    the  first 
null  hypothesis,    that  is  there  are  no  differences  between  the  sixteen 
treatment  conditions  of  the  experiment  (No  four-way  interaction),    is 
accepted. 

2.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  treatment  conditions  for  Lecture  A,    two  levels  of  content  and 
tv7o  levels  of  expressiveness,    and  the  treatment  conditions  for  Lecture 
B,    two  levels  of  content  and  two  levels  of  expressiveness.      In  order  to 
make  a  decision  on  the  acceptance  or  rejection  of  this  hypothesis,    each 
of  the  possible  combinations  of  interaction  between  the  treatment  condi- 
tions for  Lecture  A  and  the  treatment  conditions  for  Lecture  B  must  be 
examined. 

a.      Content  (A)  by  expressiveness  (A)  by  content  (B)  interaction: 
This  was  not  significant  at  the  .  05  level  (F  =  2.  98  for  1   and  262  degrees 
of  freedom). 
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Table  5 


2  X  2  X  Z  X  Z  Analysis  of  Variance  for 
Student  Ratin"  Instrument  Total  Score  on  Lecture  B 


Source              i 

df 

Sum  of  ; 

Squares 

Mean  ; 

Square 

F 

Between  Groups 

15 

28434. 

1371 

1895. 

6091 

11. 

.  2  5* 

(Model) 

Content 

10. 

7918 

10. 

7918 

,06 

(Lecture  A) 

Expressiveness 

2261. 

6510 

2261. 

6510 

13. 

,  43*=f 

(Lecture  A) 

Content 

59. 

5583 

59. 

5583 

,  35 

(Lecture  B) 

Expressiveness 

19277. 

8953 

19277. 

8953 

114. 

,  44*--t 

(Lecture  B) 

Content  (A)  x  Expres- 

26. 

9317 

26. 

9317 

,16 

siveness  (A) 

Content  (A)  x  Con- 

586. 

7555 

586. 

7555 

3. 

48 

tent  (B) 

Content  (A)  x  Expres- 

16. 

5951 

16. 

5951 

,  10 

siveness  (B) 

Expressiveness  (A)  x 

262. 

2528 

262. 

2528 

1. 

56 

Content  (B) 

Expressiveness  (A)  x 

140. 

0010 

140. 

0010 

83 

Expressiveness  (B) 

Content  (B)  x  Expres- 

1096. 

5949 

1096. 

5949 

6. 

,  51=:==:^ 

siveness  (B) 

Content  (A)  x  Expres- 

502. 

4264 

502. 

4264 

2 

98 

siveness  (A)  X 

Content  (B) 

Content  (A)  x  Expres- 

343. 

3416 

343. 

3416 

2. 

04 

siveness  (A)  X  Ex- 

pressiveness (B) 

Expressiveness  (A)  x 

44. 

0272 

44. 

0272 

26 

Content  (B)  x  Ex- 

pressiveness (B) 

Content  (A)  x  Content 

450. 

7489 

450. 

7489 

2^ 

68 

(B)  X  Expressive- 

ness (B) 

Content  (A)  x  Expres- 

358. 

5234 

3  58. 

5234 

2. 

13 

siveness  (A)  x  Con- 

tent (B)  X  Expres- 

siveness (B) 

Within  Groups  (Error)   Z62 

44133. 

5751 

168. 

4488 

Total       2' 

77 

72567. 

7122 

*(p<.05,    F(i5^262..05)  =  ^-^l 


*-(p<.05,    F(i^  262,  .  05)  =   3.  88) 
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Table  6 


Student  Rating  Instrument  Mean  Scores  for 
Lecture  B   Treatment  Groups 


Standard 
'^^Q^P N  Mean  Deviation 


17 

60.  1765 

12. 3806 

17 

71. 5294 

9.  9443 

16 

66.4375 

11. 1593 

11 

64.  1818 

14.4279 

High  Content  (Lecture  B) 

High  Expressiveness   (Lecture  B) 
High  Content  (Lecture  A) 

High  Expressiveness   (Lec- 
ture A) 
Low  Expressiveness  (Lec- 
ture A) 
Low  Content  (Lecture  A) 

High  Expressiveness  (Lec- 
ture A) 
Low  Expressiveness  (Lec- 
ture A) 
Low  Expressiveness  (Lecture  B) 
High  Content  (Lecture  A) 
High  Expressiveness 

(Lecture  A) 
Low  Expressiveness 
(Lecture  A) 
Low  Content  (Lecture  A) 
High  Expressiveness 

(Lecture  A) 

Low  Expressiveness 

(Lecture  A) 

Low  Content  (Lecture  B) 

High  Expressiveness  (Lecture  B) 
High  Content  (Lecture  A) 

High  Expressiveness  (Lee-  22  57.7727  15.0931 

ture  A) 

Low  Expressiveness  (Lee-  29  64.5172  14.0804 

ture  A) 
Low  Content  (Lecture  A) 

High  Expressiveness  (Lee-  12  53.0000  12.9263 

ture  A) 

Low  Expressiveness  (Lee-  14  66.7143  12.0667 

ture  A) 
Low  Expressiveness   (Lecture  B) 
High  Content  (Lecture  A) 

High  Expressiveness  (Lee-  12  49.0000  11.  5444 

ture  A) 


17 

40, 

,  9412 

13. 

,  9260 

28 

41. 

6786 

11. 

6684 

17 

44. 

1675 

12. 

9819 

20 

49. 

9500 

14. 

7522 
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Table  6  (Cont'd. 


Standard 
Group  N  Mean  Deviation 

Low  Expressiveness  (Lee-  16  51.2500  12.7619 

ture  A) 
Low  Content  (Lecture  A) 

High  Expressiveness  (Lee-  17  40.0588  11.4098 

ture  A) 
Low  Expressiveness  (Lee-  13  49.0769  14.3786 

ture  A) 


b.  Content  (A)  by  expressiveness   (A)  by  expressiveness   (B)  inter- 
action:    This  was  not  significant  at  the  .  05  level  (F  =  2.  04  for  1   and  262 
degrees  of  freedom). 

c.  Content  (A)  by  content  (B)  by  expressiveness  (B)  interaction: 
This  was  not  significant  at  the  .  05  level  (F  =   .26  for  1   and  262  degrees 
of  freedom). 

d.  Expressiveness  (A)  by  content  (B)  by  expressiveness  (B)  inter- 
action:    This  was  not  significant  at  the  .  05  level  (F_  =  2,  68  for  1   and  262 
degrees  of  freedom). 

e.  Content  (A)  by  content  (B)  interactions:     This  was  not  signifi- 
cant at  the  .  05  level  (F^  -  3.  48  for  1  and  262  degrees  of  freedom). 

f.  Content  (A)  by  expressiveness   (B)  interaction:     This  was  not 
significant  at  the  .  05  level  ( F  =  .10  for  1   and  262  degrees  of  freedom), 

g.  Expressiveness   (A)  by  content  (B)  interaction:     This  was  not 
significant  at  the  .  05  level  ( F^  =   1.  56  for  1  and  262  degrees  of  freedom). 

h.     Expressiveness  (A)  by  expressiveness  (B)  interaction:     This 
was  not  significant  at  the  .  05  level  (F^  =  .83  for  1   and  262  degrees  of 
freedom).     Since  none  of  the  above  results  are  significant,    the  second 
null  hypothesis,    that  there  are  no  differences  between  the  treatment 
conditions  for  Lecture  A  and  the  treatment  conditions  for  Lecture  B, 
is  accepted. 

3.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  four  treatment  conditions  for  Lecture  A,  two  levels  of  con- 
tent and  t-vo  levels  of  expressiveness.      (No  content  (A)  by  expressive- 
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ness  (A)  interaction.  )  The  F_  ratio  for  this  interaction  is  not  significant 
at  the  .  05  level  (F  =  .  16  for  1  and  262  degrees  of  freedom).  Therefore, 
the  above  null  hypothesis  is  accepted. 

4.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  content  for  Lecture  A.     (No  main  effect  for 
content  (A)),     The  _F  ratio  for  the  content  (A)  main  effect  is  not  signifi- 
cant at  the  .  05  level  (_F  =  .06  for  1  and  262  degrees  of  freedom).     There- 
fore,   the  above  null  hypothesis  is  accepted. 

5.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  expressiveness  for  Lecture  A.      (No  main 
effect  for  expressiveness(A).  )     The  _F  ratio  for  the  expressiveness  (A) 
main  effect  was  significant  at  the  .  05  level  f_F  =  13,  43  for  1   and  262 
degrees  of  freedom).     Because  of  the  above  result,    this  null  hypothesis 
is  rejected  and  the  alternate  hypothesis,    that  there  is  a  difference  be- 
tween the  expressiveness  treatment  conditions  for  Lecture  A  is  accepted. 

The  results  for  4  and  5  above  also  are  shown  by  an  examination  of 
Table  7  and  Figures  4a  and  5a.      Figure  4a  shows  graphically  that  there 
is  little  or  no  difference  between  the  means  for  the  two  content  condi- 
tions across  expressiveness  conditions.     Figure  4b  shows  graphically 
the  differences  between  the  nieans  for  the  two  conditions  of  e:'cpressive- 
ness  across  content  conditions.     In  addition,    the  low  expressiveness 
condition  received  higher  ratings  than  the  high  expressiveness  condition 
for  the  ratings  of  Lecture  B  when  examining  the  precondition  of  expres- 
siveness for  Lecture  A. 
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Table  7 


Student  Rating  Instrument  Mean  Scores  on  Lecture  B 
Collapsed  into  Lecture  A  Precondition  Treatment  Groups 


Group 

N 

Mean 

High  Content 

High  Expressiveness 

68 

51.9726 

Low  Expressiveness 

90 

57.2438 

Low  Content 

High  Elxpressiveness 

62 

50.9159 

Low  Expressiveness 

58 

57.4807 

60 
55 
50 
45 


Low  Content 
High  Content 


High  Low 

Expressiveness  Groups 


Figure  4a 
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Mean 

Rating 

Score 


60 
55 
50 
45 


High  Low 

Content  Groups 


Figure  4b 
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6.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  four  treatment  conditions  of  Lecture  B,    two  levels  of  content 
and  two  levels  of  expressiveness.     (No  content  (B)  by  expressiveness  (B) 
interaction.  )     From  Table  5,    the  _F  ratio  for  the  content  (B)  by  expres- 
siveness (B)  is  found  to  be  significant  at  the  .  05  level  {F_  -  6.  51  for  1 
and  262  degrees  of  freedom).     Because  of  the  significant  _F  ratio,    the 
null  hypothesis  is  rejected,    and  the  alternative  hypothesis,    that  there 

is  a  significant  difference  between  the  four  treatnaent  conditions  of 
Lecture  B,    is  accepted. 

However,    this  result  requires  that  to  examine  the  remaining  two 
hypotheses,    a  simple  main  effects  nnust  be  conducted  for  the  above 
interaction  (Kirk,    1968).     This  was  done,    and  the  results  are  reported 
in  table  8. 

7.  There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  content  for  Lecture  B.      (No  main  effect  for 
content  (B).  )    To  examine  this  hypothesis,    content  (B)  must  be  analyzed 
at  both  levels  of  expressiveness  (B).      This  was  done.     When  expressive- 
ness (B)  was  high,    the  content  (B)  dimension  did  not  produce  a  signifi- 
cant F_  ratio  at  the  .  01  level  (F_  =  5,  21  for  1   and  262  degrees  of  freedom). 
When  expressiveness  (B)  was  low,    the  content  dimension  did  not  produce 
a  significant  F_  ratio  at  the  .  01  level  (_F  -  2.  02  for  1   and  262  degrees  of 
freedom).      Thus  the  null  hypothesis,    that  there  are  no  differences  be- 
tween the  two  conditions  of  content  (B),   is  accepted. 
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Table  8 


Z  X  2  X  Z  X  Z  Analysis  of  Variance  for  Student  Rating  Instrument 

Total  Score  on  Lecture  B:     Sinaple  Main  Effects  for  Content  (B)  x 

Expressiveness   (B )  Interaction 


Source 


Sum  of  Squares      Mean  Square 


Content  at  1  878,  4Z18  878.4218  5.  Zl 

High  Expressiveness 
Content  at  1  339.6761  339.6761  Z.  02 

Low  Expressiveness 
Expressiveness  at  1  16014.5010  16014.5010         95.07* 

High  Content 
Expressiveness  at  1  5724.  6ZZ4  57Z4.  6224        33.98* 

Low  Content 
Within  Groups  262  44133.5751  168.4488 

(Error) 


''(P<-^''    ^(1,Z6Z,.01)  =  ^-^^) 
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8.     There  will  be  no  differences  on  the  dependent  variables  be- 
tween the  two  conditions  of  expressiveness  for  Lecture  B,      (No  main 
effect  for  expressiveness   (B).  )     To  examine  this  hypothesis,    expressive- 
ness  (B)  must  be  analyzed  at  both  levels  of  content  (B).     This  was  done. 
When  content  (B)  was  high,    the  expressiveness  (B)  dimension  produced 
a  significant  F^  ratio  at  the  .  01  level  (_F  =  95.  07  for  1  and  262  degrees 
of  freedom).     When  content  (B)  was  low,    the  expressiveness  (B)  dimen- 
sion produced  a  significant  F_  ratio  at  the  .  01  level  {F_  =  33.  98  for  1  and 
262  degrees  of  freedom).     Because  of  the  above  results,    the  null  hypoth- 
esis is  rejected  and  the  alternative  hypothesis,    that  there  is  a  difference 
between  the  two  le^^els  of  expressiveness   (B),    is  accepted. 

The  results  for  7  and  8  above  are  shown  further  by  an  examina- 
tion of  Table  9  and  Figures   5a  and  5b.      Table  9  presents  the  means  for 
the  four  treatment  conditions  examined  for  Lecture  B.      Figure  5a 
shows  graphically  the  lack  of  difference  between  the  content  (B)  condi- 
tions across  expressiveness  (B)  conditions.      Figure  5b  shows  graphi- 
cally the  differences  between  the  expressiveness  (B)  conditions  across 
the  content  (B )  conditions. 

Summarizing  the  results  from  the  Lecture  B  analysis,    there  is  a 
significant  difference  between  the  precondition  expressiveness  (A) 
groups  on  the  ratings  of  Lecture  B  with  the  low  expressiveness  (A) 
dimension  being  rated  higher  than  the  high  expressiveness  (A)  dimen- 
sion.    Also,    there  is  a  significant  difference  bet-ween  the  expressive- 
ness  (B)  groups  across  content  for  both  levels  of  content. 
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Table  9 


Student  Rating  Instrument  Mean  Scores  on  Lecture  B 
Collapsed  into  Lecture  B  Treatment  Groups 


Group 


N 


Mean 


High  Content 

High  Expressiveness 
Low  Expressiveness 

Low  Content 

High  Expressiveness 
Low  Elxpressiveness 


61 

65.5813 

77 

44. 1843 

82 

60. 5011 

58 

47.3464 

Mean 

Rating 

Score 


70 
65 
60 
55 
50 
45 
40 


Low  Content 
High  Content 


High  Low 

Expressiveness  Groups 


Figure  5a 
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70 
65 
60 
55 
50 
45 
40 


High  Content 


Low  Content 


High 


Low 


Content  Groups 


Figure  5b 
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The  Lecture  Choice  Variable  Analysis 
As  was  stated  in  the  methodology  chapter,    two  types  of  analyses 
are  appropriate  for  the  lecture  choice  data,    in  addition  to  descriptive 
information.     One  analysis  is  a  Spearman  rank-order  correlation  be- 
tween lecture  choice  and  rating  choice  (which  of  the  two  lectures  was 
rated  higher  by  the  student).     The  second  analysis  is  to  conduct  a  chi- 
square  analysis  on  the  lecture  choice  variable  and  the  rating  choice 
variable,    separately.      The  above  analyses  were  done  and  the  results 
are  reported  below. 

Descriptively,    Table  10  presents  a  frequency  distribution  break- 
down of  the  lecture  choice  and  rating  choice  variables.     As  can  be  seen 
in  Table  10,    73  students  (26.26%)  selected  Lecture  A;    204  students 
(73.  38%)  selected  Lecture  B;    one  person  did  not  select  a  lecture.      For 
the  rating  choice  variable,    94  students  (33.81%)  rated  Lecture  A  higher; 
170  students  (61.  15%)  rated  Lecture  B  higher;    14  students  (5.4%)  rated 
the  two  lectures  identically. 

The  Spearman  rank-order  correlation  between  lecture  choice  and 
rating  choice  yielded  a  value  of  .  618.     While  this  value  is  significantly 
different  from  zero  (p  <.  01),    it  is  not  of  practical  significance.     The 
.  618  correlation  indicates  some  lack  of  agreement  between  how  students 
rated  a  lecture  and  which  lecture  they  chose  as  better,    and  that  there 
are  reasons  for  this  lack  of  agreement  between  these  two  variables. 
An  examination  of  the  frequencies  for  both  the  lecture  choice  and  rating 
choice  variable  in  Table  10  yields  the  following  trend.      The  lecture 
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Table   10 


Sample  Population  Frequency  Distribution  on 
Lecture  Choice  and  Rating  Choice  Variables 


Cum  Cum 

Freq Freq P  e  r  c  ent Percent 


Lecture  Choice  Variable 


No  Choice 

1 

1 

0.360 

0.  360 

Lecture  A 

73 

74 

26.259 

26.  619 

Lecture  B 

Z04 

278 

73.  381 

100.  000 

Rating  Choice  Variable 


No  Choice 

14 

14 

5.  036 

5.036 

Lecture  A 

94 

108 

33.813 

38.849 

Lecture  B 

170 

278 

61. 151 

100.  000 
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choice  variable  has  a  greater  frequency  of  choice  of  Lecture  B  than 
does  the  rating  choice  variable.      This  may  indicate  a  weakness  in  the 
use  of  a  global,    overall  selection  variable,    or  it  may  be  that  the  factors 
of  content  and  expressiveness  for  Lecture  B  or  a  cumulative  effect  over 
both  lectures  may  be  influencing  the  lecture  choice.      This  problem  will 
be  addressed  in  the  conclusion  section  of  the  next  chapter. 

The  chi-square  analysis  for  the  lecture  choice  variable  and  for 
the  rating  choice  variable  is  presented  in  Table  11.      The  lecture  choice 
variable  yielded  a  X^  =  9.  542;    at  three  degrees  of  freedom,    this  is  sig- 
nificant at  the  .  05  level.      The  rating  choice  variable  produced  a 
X     =   3.  048,    which  is  not  significant  at  the  .  05  level  with  three  degrees 
of  freedom.     In  looking  at  the  frequencies  reported  for  both  variables, 
there  is  a  tendency  to  select  Lecture  B  more  often  than  Lecture  A,    and 
a  tendency  to  select  the  high  expressiveness  lectures  rather  than  the 
low  expressiveness  lectures.      There  is  no  apparent  trend  for  the  content 
dimension. 
The  Adjective  Checklist  Analysis 

The  analysis  for  the  adjective  checklist  was  conducted  by  exam- 
ining which  of  the  four  lecture  combinations  (high  content-high  expres- 
siveness,   high  content-low  expressiveness,    low  content-high  expressive- 
ness,   or  low  content-low  expressiveness)  a  student  chose  (or  rated 
higher)  as  the  better  lecture  in  relation  to  whether  or  not  that  student 
chose  a  particular  adjective.      The  results  of  this  frequency  analysis 
for  the  lecture  choice  variable  are  reported  in  Appendix  E,    and  for  the 
rating  choice  variable  in  Appendix  F. 
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Table  11 


Sample  Population  Frequency  Distribution  on  Lecture  Choice 
and  Rating  Choice  Variables  across   Type  of  Lecture 


Lecture  Type* 

Lecture  Choice 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Lecture  A 

34 

10 

23 

6 

freq.    % 

12.3 

3.6 

8.3 

2.2 

Lecture  B 

58 

44 

69 

33 

freq.    % 

20.  9 

15.9 

24.  9 

11.9 

Rating  Choice 

Lecture  A 

38 

17 

26 

13 

freq.    % 

14.4 

6.4 

9.9 

4.9 

Lecture  B 

51 

37 

57 

25 

freq.    % 

19.3 

14.  0 

21.  6 

9.  5 

HC  =  High  Content 

LC  -   Low  Content 

HE  =  High  Expressiveness 

LE  =  Low  Expressiveness 
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In  order  to  conduct  the  chi-square  analysis  for  each  adjective,    the 
significance  level  was  set  at  .  01  because  of  the  number  of  adjectives 
being  considered  and  because  of  the  significant  chi-square  for  the  lec- 
ture choice  variable  analysis.      The  results  of  the  chi-square  analysis 
for  the  adjectives  with  lecture  choice  is  presented  in  Table  12.      The 
results  of  the  chi-square  analysis  for  the  adjectives  with  rating  choice 
is  presented  in  Table  13.     A  comparison  of  the  adjectives  with  signifi- 
cant chi-squares  for  the  lecture  choice  and  the  rating  choice  variables 
is  presented  in  Table  14.     It  should  be  noted  that  with  three  exceptions 
(logical,    showmanship,    and  persuasive  are  absent  from  the  rating  choice 
variable  list),    the  two  lists  are  identical. 

An  examination  of  the  frequency  tables  in  Appendices  E  and  F  for 
these  adjectives  with  significant  chi-squares  yields  two  trends  in  the 
frequency  distributions  for  both  the  lecture  choice  and  the  rating  choice 
variable.     The  first  trend  is  that,    with  three  exceptions  (knowledgeable, 
orderly,    and  logical),    for  both  the  lecture  choice  and  the  rating  choice 
variable,    all  the  adjectives  tend  to  have  higher  frequencies  related  to 
the  high  expressiveness  lectures.      The  second  trend  is  that,    for  the 
exceptions  cited  above  (only  knowledgeable  and  orderly  in  the  case  of 
the  rating  choice  variable),    all  tend  to  have  frequencies  associated  to 
the  high  content  lectures,    but  more  specifically  to  the  high  content-high 
expressiveness  lecture. 
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Table  12 


Chi-Square  Values  for  Adjectives  on 
Lecture  Choice  Variable 


Adjective 

Chi-Square 

Adjective 

Chi-Square 

Dramatic 

47. 378* 

Enthusiastic 

96.341* 

Knowledgeable 

14.774* 

Showmanship 

12.017* 

Thorough 

4.521 

Vital 

4.894 

Coherent 

5.477 

Concise 

5.  680 

Well-prepared 

4.026 

Lucid 

1.  058 

Energetic 

94. 109* 

Enjoyable 

20.780* 

Logical 

13.378* 

Clear 

1.900 

Ebcplanatory 

7.286 

Inventive 

3.  977 

Inspiring 

16.973* 

Cultured 

7.773 

Understandable 

4.  164 

Confident 

6.  118 

Well-paced 

3.993 

Poised 

4.398 

Elxpressive 

48.246* 

Humorous 

49.172* 

Forceful 

31.729* 

Sparkling 

14.145* 

Interesting 

22.463* 

Competent 

5.  134 

Variety 

1.986 

Charismatic 

8.  122 

Stim\ilating 

27. 030* 

Conscientious 

1.089 

Interested 

13.093* 

Dynamic 

26. 206* 

Warm 

14.862* 

Well-groomed 

0.  180 

Scholarly 

4.404 

Organized 

1.935 

Orderly 

19.220* 

Careful 

6.671 

Stylized 

5.910 

Witty 

24.  496* 

Motivating 

27. 598* 

Unique 

5.627 

Masterful 

1.  192 

Persuasive 

11.354* 

*  p<.01,    df  =  3 
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Table  13 


Chi -Square  Values  for  Adjectives  on 
Rating  Choice  Variable 


Adjective 

Chi -Square 

Adjective 

Chi-Square 

Dramatic 

36.775* 

Enthusiastic 

81.  640* 

Knowledgeable 

12. 914* 

Showmanship 

8.  605 

Thorough 

4.  621 

Vital 

5.  185 

Coherent 

2.  106 

Concise 

2.865 

Well-prepared 

0.996 

Lucid 

0.845 

Energetic 

74.  896* 

Enjoyable 

17. 548* 

Logical 

7.  542 

Clear 

3,  360 

Explanatory 

7.  198 

Inventive 

7.474 

Inspiring 

12. 542* 

Cultured 

7.  697 

Understandable 

2.568 

Confident 

4.212 

Well-paced 

3.469 

Poised 

4.092 

Expressive 

44. Oil* 

Humorous 

49.  015* 

Forceful 

2  6.  046* 

Sparkling 

14.863* 

Interesting 

22.284* 

Competent 

4.  505 

Variety- 

4.  606 

Charismatic 

8.531 

Stimulating 

2  5.  418* 

Conscientious 

1.  638 

Interested 

13.727* 

Dynamic 

24.851* 

Warm 

15.851* 

Well-groomed 

0.  551 

Scholarly 

8.899 

Organized 

2.  025 

Orderly 

11. 461* 

Careful 

4.  440 

Stylized 

7.963 

Witty 

22. 92  5* 

Motivating 

26.201* 

Unique 

3.044 

Masterful 

0.482 

Persuasive 

9.  903 

*    p<  .  01,    df  =  3 
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Table  14 


Comparison  of  Lecturer  Characteristics  Significant  for 
Lecture  Choice  Variable  and  for  Rating  Choice  Variable 


Lecture 
Choice  Variable 


Rating 
Choice  Variable 


Dramatic 
Knowledgeable 
Energetic 
Logical 
Inspiring 
Expressive 
Forceful 
Interesting 
Stimulating 
Interested 
Warm 
Orderly- 
Motivating 
Enthusiastic 
Showmanship 
Enjoyable 
Humorous 
Sparkling 
Dynamic 
Witty 
Persuasive 


Dramatic 

Knowledgeable 

Energetic 

Inspiring 

Expressive 

Forceful 

Interesting 

Stimulating 

Interested 

Warm 

Orderly 

Motivating 

Enthusiastic 

Enjoyable 
H\imorous 

Sparkling 

Dynamic 

Witty 
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Suinniary  of  the  Results 

The  summary  of  the  results  will  be  presented  in  two  parts.     A 
s\immary  of  the  results  of  the  analyses  of  the  student  rating  instrument 
for  both  Lecture  A  and  Lecture  B  will  be  presented  first.      Then,    a  sum- 
mary of  the  lecture  choice  variable  and  the  adjective  checklist  results 
will  be  considered. 

The  results  of  the  student  rating  instrument  analysis  yielded  two 
consistent  factors:     (1)  a  significant  interaction  between  content  and 
expressiveness  for  the  lecture  under  consideration,    and  (2)  after  con- 
ducting a  simple  main  effects  analysis  for  each  lecture,    a  significant 
difference  between  high  expressiveness  and  low  expressiveness  lectures 
was  found  for  both  levels  of  content  for  each  lecture  considered.     In 
addition,    there  were  two  additional  findings.     For  Lecture  A,    the  simple 
main  effects  analysis  found  a  significant  difference  between  high  content 
and  low  content  lectures  when  expressiveness  was  high,    but  not  v/hen 
expressiveness  was  low.     For  the  Lecture  B,    the  precondition  of  ex- 
pressiveness for  Lecture  A  produced  a  significant  difference  betv/een 
high  and  low  expressiveness  levels  for  both  levels  of  content.      The 
above  differences  were  the  result  of  differences  on  the  total  score  of 
the  student  rating  instrument. 

For  the  lecture  choice  variable  analysis,    a  comparison  with  the 
rating  choice  variable  yielded  a  Spearman  rank-order  correlation  of 
.618,   which  is  significantly  different  from  zero,    but  is  not  practically 
significant.     The  chi- square  analysis  of  the  lecture  choice  variable 
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yielded  a  significant  chi- square  value.     A  chi- square  analysis  of  the 
rating  choice  variable  did  not  produce  a  significant  chi- square  value. 
In  an  exainination  of  both  analyses  for  trends,    the  results  yielded  a  ten- 
dency to  choose  Lecture  B  over  Lecture  A  and  to  select  high  expressive- 
ness lectures  over  low  expressiveness  lectures. 

The  results  of  the  adjective  checklist  were  as  follows: 

1.  A  chi- square  analysis  with  lecture  choice  yielded  21  adjectives 
with  significant  chi- square  values. 

2.  A  chi-square  analysis  with  rating  choice  yielded  18  adjectives 
with  significant  chi-square  values. 

3.  A  comparison  of  the  lists  of  adjectives  found  significant 
showed  that  the  lists  were  identical  with  the  exception  of  three  adjectives 
not  on  the  rating  choice  list. 

4.  In  the  cases  of  18  of  the  21  adjectives  from  above,    an  exam- 
ination of  the  frequencies  showed  a  trend  toward  higher  frequencies  for 
the  particular  adjective  associated  with  the  high  expressiveness  lectures. 

5.  In  the  cases  of  three  of  the  adjectives  excepted  above,    an 
examination  of  the  frequencies  showed  a  trend  toward  higher  frequencies 
for  the  adjectives  associated  with  high  content  lectures,    specifically, 
high  content-high  expressiveness  lectures. 


Chapter  V 
SUMMARY,    CONCLUSIONS,    AND  RECOMMENDATIONS 

S\jxnmary 

The  purpose  of  this  study  was  to  examine  the  influence  of  the 
Doctor  Fox  effect  (i.  e.    expressive  teaching  behaviors)  on  student 
ratings  of  instruction  when  students  were  given  the  opportunity  to  com- 
pare a  pair  of  lectures  varying  in  levels  of  content  and  expressiveness. 
Also,    the  study  was  to  examine  students'  identification  of  lecturer  char- 
acteristics as  these  characteristics  were  related  to  expressive  teaching 
behaviors. 

Several  reasons  for  conducting  this  study  were  cited.      From  a 
review  of  the  literature  on  the  use  of  student  ratings  and  the  validit'y  of 
student  ratings,    the  following  trends  were  enumerated  as  important  for 
this  study.      (1)  There  is  an  increased  use  of  student  ratings  of  instruc- 
tion by  college  administrators  for  personnel  decision-making  affecting 
facility  promotion,    tenure,    and  salary  increases.      (2)  The  student  ratings 
of  instructors  are  influenced  by  the  student  perception  of  how  these 
ratings  will  be  used.      (3)  A  number  of  approaches  to  validating  student 
ratings  have  been  used;    the  results  of  these  validation  studies  are  mixed 
and  inconclusive,      (4)  The  inconclusiveness  of  validation  results  has 
increased  the  concern  over  the  validity  of  the  use  of  student  ratings  by 
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college  administrators  for  personnel  decision-making.      From  a  review 
of  the  literature  on  the  Doctor  Fox  effect,    the  following  points,    relevant 
to  this  study,    were  made.      (1)  There  have  been  no  studies  of  the  Doctor 
Fox  effect  providing  students  with  an  opportunity  to  compare  immediately 
lectures  varying  in  content  and  in  expressiveness.      (2)  The  literature 
did  not  provide  any  specific  experimental  information  or  insight  as  to 
what  are  the  high  expressive  behaviors  of  the  Doctor  Fox  effect.      (3) 
Any  additional  studies  of  the  Doctor  Fox  effect  will  add  to  the  literature 
on  the    validity  of  student  ratings,    since  such  studies  examine  the  influ- 
ence of  lecturer  expressiveness  on  student  ratings  of  instruction. 

Two  hundred  and  seventy-eight  (278)  subjects  were  assigned  ran- 
domly within  intact  classes  or  groups  to  16  treatment  conditions.      The 
sixteen  treatment  conditions  consisted  of  all  ordered  pair  corabinations 
of    the  four  lecture  segmients  (high  content-high  expressiveness,    high 
content-low  expressiveness,    low  content-high  expressiveness,    and  low 
content-low  expressiveness),    which  were  approximately  five  minutes  in 
duration  each,    used  for  this   study.      The  subjects  viewed  one  lecture  seg- 
ment (Lecture  A)  of  the  pair,    rated  it,    viewed  the  second  lecture  seg- 
ment (Lecture  B)  of  the  pair,    rated  it,    selected  which  of  the  two  lecture 
presentations  v/as  the  better  presentation,    and  finally,    selected  adjec- 
tives,   characteristic  of  the  instructor,    which  influenced  their  choice  of 
the  better  lecture  presentation.      Thus  the  dependent  measures  for  this 
study  were  (1)  a  total  student  rating  instrument  score  (the  rating  instru- 
ment used  was  the  same  instr-oment  used  by  Ware  (1974),    (2)  a  lecture 
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choice  variable,    and  (3)  a  choice/no  choice  on  each  of  the  adjectives  on 
the  adjective  checklist. 

Separate  analyses  on  the  student  rating  instrument  total  score  for 
Lecture  A  and  for   Lecture  B,    on  the  lecture  choice  variable,    and  on  the 
adjectives  were  conducted.      The  Z  x  2  (content  x  expressiveness)  anal- 
ysis on  the  student  rating  instrument  total  score  for  Lecture  A  yielded 
the  following  results:     (1)  a  significant  interaction  between  content  and 
expressiveness,    (2)  a  significant  difference  toward  higher  ratings  of  the 
high  content  versus  the  low  content  lectures  when  expressiveness  was 
high,    and  (3)  a  significant  difference  toward  higher  ratings  of  high 
expressiveness  versus  low  expressiveness  lectures  for  both  levels  of 
content.      The  2x2x2x2  (content  of  Lecture  A  x  expressiveness  of 
Lecture  A  x  content  of  Lecture  B  x  expressiveness  of  Lecture  B)  of  the 
student  rating  instrument  total  score  yielded  the  following  results:     (1) 
a  significant  interaction  between  content  and  expressiveness  for  Lecture 
B,    (2)  a  significant  difference  toward  higher  ratings  of  high  expressive- 
ness versus  low  expressiveness  lectures  for  both  levels  of  content  for 
Lecture  B,    and  (3)  the  high  and  low  expressiveness  preconditions  for 
Lecture  A  produced  a  significant  difference  in  the  ratings  of  Lecture  B 
for  both  precondition  content  levels.      The  chi-square  analysis  of  the  lec- 
ture choice  variable  yielded  the  following  results:     (1)  a  significant  dif- 
ference in  the  frequency  of  choice  of  Lecture  B  over  Lecture  A  and  (2) 
a  trend  toward  the  selection  of  high  expressiveness  lectures  over  low 
expressiveness  lectures.      The  chi-square  analysis  of  the  adjectives  on 
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the  adjective  checklist  yielded  the  following  results:  (1)  21  of  the  47  ad- 
jectives had  significant  difference  in  choice  versus  no  choice  and  (2)  18 
adjectives  (dramatic,  energetic,  inspiring,  expressive,  forceful,  inter- 
esting, stimulating,  interested,  warm,  motivating,  enthusiastic,  show- 
manship, enjoyable,  humorous,  sparkling,  dynamic,  witty,  and  persua- 
sive) showed  a  strong  relationship  with  the  high  expressiveness  lectures. 

Conclusions 

Overall,    the  results  of  this  study  seem  to  point  in  one  direction, 
confirmation  of  the  primary  premise  of  the  Doctor  Fox  effect.     In  other 
words,    the  results  showing  differences  on  the  student  ratings  of  the  lec- 
tures and  on  the  lecture  choice  variable  due  to  the  expressiveness  dimen- 
sion for  both  levels  of  content  confirms  the  Doctor  Fox  effect  research 
previously  mentioned.      Further,    it  appears  that  the  expressiveness  di- 
mension does  have  a  primary  influence  on  the  student  ratings  of  instruc- 
tion. 

The  results  of  this  study  seein  to  indicate  that  previous  experience, 
or  the  opportunity  to  compare  lecturing  styles,    also  may  influence  eval- 
uation of  the  teaching  process  by  students.     A  careful  examination  must 
be  made  of  the  result  of  the  significant  difference  between  the  ratings  of 
high  and  low  expressiveness  lectures  produced  by  the  expressiveness 
precondition  of  the  first  lectare.      This  result  shewed  that  low  express- 
iveness of  the  first  lecture  influenced  higher  student  ratings  of  the  sec- 
ond lecture  and  that  high  expressiveness  of  the  first  lecture  influenced 
lower  student  ratings  ol  the  second  lecture.      This  result  was  true  for 
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both  precondition  content  levels.     Since  there  were  no  significant  inter- 
actions between  the  preconditions  of  the  first  lecture  and  the  treatment 
conditions  of  the  second  lect-are,    it  can  be  concluded  that  the  expressive- 
ness precondition  of  the  first  lecture  presentation  has  an  independent 
influence  on  the  student  ratings  of  the  second  lecture  presentation.      This 
precondition  expressiveness  influence  is  independent  of  the  influence 
that  the  content  and  expressiveness  levels  of  the  second  lecture  presen- 
tation have  on  the  student  ratings  of  that  second  lecture  presentation. 

The  results  of  Ware  and  Williams   (197  5a)  and  Williams  and  Ware 
(1977)  indicated  a  secondary  premise,    or  corollary,    to  the  Doctor  Fox 
effect.      The  conclusion,    drawn  from  their  results,    was  that  under  a  con- 
dition of  high  expressiveness,    lecture  content  would  have  no  effect  on 
student  ratings;    under  low  expressiveness  conditions,    lecture  content 
would  have  an  effect  on  student  ratings.      The  results  of  this  study  dc  not 
support  entirely  this  conclusion.     In  fact,    for  the  analysis  of  the  first 
lecture,    the  exact  opposite  of  this  conclusion  was  found.      For  the  first 
lecture,    the  results  showed  no  difference  in  student  ratings  for  content 
at  low  expressiveness;    however,    at  high  expressiveness,    there  was  a 
significant  difference  in  the  rating  of  the  high  content  versus  the  low  con- 
tent lectures.     However,    this   significant  difference  disappeared  for  the 
analysis  of  the  second  lecture. 

The  explanation  of  this   reversal  of  the  content  dimension  results 
may  lie  in  the  shortness  of  the  lecture  presentation.     It  may  be  that  five 
minutes  is  not  enough  time  to  ascertain  fully  the  content  present  in  the 
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lecture  segment.     Rather,    the  rating  difference  may  be  an  artifact  of  the 
content  by  expressiveness  interaction.      This  explanation  is   supported  by 
the  fact  that  the  result  disappears  when  the  second  lecture  results  are 
examined.     Thus,    this  shortness  of  time  may  focus  the  attention  of  the 
students  on  the  nnore  easily  recognizable  quality  in  lecturing  style;    that 
of  expressiveness. 

This  focusing  on  the  expressiveness  of  the  lecture  by  students  is  ' 
supported  additionally  by  the  lecture  choice  and  adjective  checklist  re- 
sults.    Students  had  a  tendency  to  select  high  expressiveness  over  low- 
expressiveness  lectures.     Also,    IS  out  of  the  Zl  adjectives  with  signifi- 
cant frequency  distributions   showed  a  tendency  to  be  related  to  high 
expressiveness  lectures.      These  same  18  adjectives  were  descriptive  of 
the  expressive  lecturer.     In  fact,    15  of  the  18  adjectives  came  directly 
from  Ware's  (1974)  definition  of  expressiveness.      These  factors  seem  to 
be,    at  least,    a  confirmation  that  students  can  identify  high  expressive 
behaviors  when  selecting  adjectives  which  influence  their  choice  of  a 
best  or  better  lecture  presentation.      The  conclusion  from  the  facts 
above  is  that  students'   selection  of  which  lecture  was  better  is  based 
primarily  on  high  expressive  behaviors. 

As  a  means  of  summarizing  the  conclusions  of  this  study,    an  exam- 
ination of  each  of  the  original  research  questions  follows: 

1.      Do  levels  of  lecturer  effectiveness  and  levels  of  lecture  content 
interact  with  each  other  in  affecting  student  evaluation  of  lecturer  effec- 
tiveness"-'    Yes,    they  do.      This  is  a  confirmation  of  the  original  Doctor 
Fox  effect  experiment. 


2.  After  viewing  a  second  lecture  presentation  varying  in  content 
and/or  expressiveness  from  the  first  lecture  presentation,    do  levels  of 
content  and  levels  of  expressiveness  of  this   second  lecture  interact  with 
levels  of  content  and  levels  of  expressiveness  of  the  first  lecture  pre- 
sentation in  affecting  the  student  evaluation  of  lecturer  effectiveness? 
No,    not  directly.      The  results   showed  that  the  expressiveness  level 
from  the  first  lecture  (a  precondition)  has  an  independent  effect  on  the 
student  ratings  of  the  second  lecture. 

3.  Are  there  differences  in  student  evaluations  of  lecturer  effec- 
tiveness for  lectures  which  are  high  in  expressiveness  as  opposed  to 
those  which  are  low  in  expressiveness?     Yes,    for  both  lecture  analyses 
and  for  the  lecture  choice  and  adjective  checklist  analyses. 

4.  Does  level  of  content  in  a  lecture  presentation  affect  student 
evaluation  of  lecturer  effectiveness':'     The  answer  to  this  question  is 
ambivalent.     Differences  were  found  for  the  first  lecture  analysis  only 
if  expressiveness  was  high.     No  differences  were  found  for  the  analysis 
of  the  second  lecture.     The  adjective  checklist  analysis  yielded  three 
adjectives  (knowledgeable,    orderly,    and  logical)  which  were  partially 
related  to  high  content  lectures, 

5.  Are  there  differences  in  student  choices  of  adjectives,  char- 
acteristic of  the  instructor,  to  describe  what  they  feel  is  a  better  lec- 
ture presentation?  Yes.  These  differences  in  choices  showed  a  trend 
toward  a  relationship  with  high  expressiveness  lectures. 
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Recommendations 


Two  types  of  recomjnendations  and  comments  are  warranted  as  a 
result  of  this   study.      The  first  are  specific  research  recommendations     ' 
for  further  study.      The  second  type  are  implications,    recommendations, 
and  comments  related  to  issues  raised  in  this  study. 

The  following  are  the  research  recommendations  for  further  study. 

1.     A  different  analysis  of  this  data  using  changes  in  student  rating 
instrument  scores  from  Lecture  A  to  Lecture  B  to  look  at  order  effects 
of  lecture  presentation  on  expressiveness  and  content  and  to  examine 
the  independent,    expressiveness  precondition  effect  on  student  ratings. 

Z.     A  follow-up  study  varying  the  time  of  lecture  presentatio.i  to 
determine  if  time  exposure  is  a  factor  influencing  student  ratings. 

3.      The  development  of  a  systematic  observation  instrv.iTient  from, 
the  adjectives  identified  as   significant  and  shown  to  be  related  to  high 
expressive  behaviors  and  then  testing  the  reliability  and  validity  of  such 
an  instrument.      (The  developm.ent  of  such  an  instrximent  would  enable 
researchers  to  look  at  the  Doctor  Fox  effect  in  a  real  classroomx  setting 
over  an  entire  quarter.      Further,    it  would  aid  in  faculty  developmient 
programs  by  providing  a  tool  to  assess  faculty  lecturing  style  and  then 
by  providing  feedback  to  faculty  to  aid  them  in  the  im.provement  of  their 
lecturing  style. ) 

The  implications  of  this  study  and  the  attendent  recommendations 
and  com^m^ents  relate  to  tv^'o  issues  raised  previously.      Those  issues 
are  the  increased  use  of  st'.ident  ratings  of  instruction  by  college 
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administrators  for  personnel  decision-making  and  the  inconclusive 
results  of  validity  research  on  student  ratings  of  instruction.     Since  the 
use  of  student  ratings  hinges  on  the  validity  question,    the  issue  of  the 
validity  of  student  ratings  is  considered  first. 

The  results  of  this   study  imply  that  the  primary  influence  on 
student  ratings  of  instruction  is  expressive  lecturing  style  and  behaviors. 
In  addition,    this   study  iniplies  that  students,   when  comparing  lecture 
presentations  varying  in  content  and  expressiveness,  are  not  able  to 
identify  differences  in  content  level,    or  at  the  very  least,    become  un- 
aware of  content  level  in  a  lecture  presentation.     These  implications 
raise  serious  questions  about  the  validity  of  student  ratings.     Supposedly 
student  ratings  pro\T.de  an  assessment  of  the  student's  perception  of  a 
faculty  member's  ability  to  teach  content.      Yet,    the  conclusions  of  this 
study  are  that  student  perception  is  influenced  primarily  by,    not  what 
the  professor  presents,   but  how  he  presents  it.      Thus,    student  ratings 
are  providing  an  assessment  only  of  student  perception  of  teaching  style, 
and  this  is  only  pare  of  the  picture. 

The  validity  of  student  ratings  can  not  be  assessed  completely  if 
student  reporting  of  facility  teaching  is  biased  because  of  expressive 
teaching  style.     Student  ratings  do  not  provide  all  of  the  information 
necessary  for  adrriinistrators  to  assess  faculty  teaching  performance, 
let  alone  for  administrators  to  make  personnel  decisions  about  faculty 
promotion,    tenure,    and  salary  increases. 

The  increased  use  of  student  ratings  is  questionable  in  the  light  of 
the  above  imolications  from  the  results  of  this  study.     If  it  is  in  fact  the 
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case  that  faculty  performance  is  being  judged  solely  on  the  basis  of  stu- 
dent ratings,    then  faculty  members  with  a  nonexpressive  teaching  style 
are  being  punished  in  cases  where  student  ratings  are  used  primarily 
for  personnel  decisions.      Further,    students  can  be  fooled  or  seduced 
into  believing  a  faculty  member  is  a  good  teacher  solely  by  his  exhibi- 
tion of  a  highly  expressive  teaching  style,    regardless  of  the  amount  of 
information  that  the  faculty  member  may  be  imparting  to  students.     Thus, 
it  may  be  possible  to  reward  a  faculty  member,    who  teaches  his  students 
little  or  no  information,   because  he  has  a  highly  expressive  teaching 
style  and  high  student  ratings  as  a  result  of  that  teaching  style. 

The  above  im.plications  lead  to  the  recommendation  of  a  restruc- 
turing of  faculty  evaluation  and  reward  procedures.     Cook  and  Ne\-ille 
(1971)  have  suggested  that  some  form  of  a  multiple  data  approach  to  fac- 
ulty evaluation  is  necessary.      The  results  of  this  study  support  that  con- 
tention.     To  begin  with,    since  student  ratings  of  instruction  can  be  influ- 
enced by  expressive  lecture  style,    student  ratings  can  provide  an  accu- 
rate assessment  of  the  expressiveness  of  teaching  style.      This  is  not  to 
negate  the  value  of  student  ratings.     Rather,    it  says  that  student  ratings 
of  lecture  style  are  important.     Ware  and  Williams  (1975a)  and  Williams 
and  Ware  (1977)  have  shown  that  high  expressive  teaching  style  and  be- 
haviors have  a  positive  influence  on  student  achievement.      This  alone  is 
reason  enough  to  include  student  ratings  as  part  of  a  multiple  data  ap- 
proach to  faculty  evaluation. 

However,    student  ratings  do  not  assess  accurately  actual  impact 
of  teaching  style  on  student  learning  growth.     While  teaching  style  does 
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have  an  effect  on  learning  growth,    the  measurement  of  learning  growth 
by  student  ratings  is  not  appropriate  because  of  the  above  mentioned 
influence  of  expressiveness  on  student  perceptions  of  faculty  teaching 
ability.      Thus,    the  direct  measurement  of  student  learning  growth 
should  be  considered  as  a  second  part  of  a  multiple  data  approach  to 
faculty  evaluation.     While  final  course  examinations,    final  course 
grades,    and  achievement  tests  are  all  measures  of  student  achievement, 
they  fail  to  control  for  any  of  the  student's  previous  experiences  with 
course  material  or  related  course  material.     It  is  more  appropriate,    in 
measuring  teacher  impact  on  student  learning  growth,    to  use  a  pre  - 
post  achievement  gain  score.      This  gain  score  controls  for  the  precon- 
ditions of  any  previous  student  learning,    and  thus  is  a  better  measure 
of  the  impact  of  faculty  teaching  ability  on  student  learning  growth. 

So  far,    two  pa.rts  of  a  multiple  data  approach  have  been  identified; 
they  are  student  ratings  of  instruction  and  achievement  gain  scores.     A 
final  piece  of  information  should  be  considered  in  order  to  complete  the 
picture  of  faculty  teaching  performance  evaluation.      This  information 
should  illuminate  the  student/teacher  interaction  in  the  classroom.     One 
of  the  better  ways  to  assess  this  interaction  is  through  systematic  obser- 
vation techniques.      This  study  has  identified  a  number  cf  lecturer  char- 
acteristics  related  to  expressive  teaching  style.     These  characteristics 
can  be  converted  into  a  systematic  observation  instriunent  to  obtain  in- 
formation on  student/teacher  interaction  in  the  classroom.     The  syste- 
matic observation  instrument,    when  used  by  trained  observers,    would 
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provide  an  unbiased  view  of  the  student/teacher  interaction,    as  well  as 
an  objective  assessment  of  teaching  style.     With  the  information  of  sys- 
tematic observation,    student  ratings,    and  achievement  gains,    a  college 
administrator  would  have  the  appropriate  information  about  faculty 
teaching  performance  upon  which  to  base  decisions  affecting  faculty  pro- 
motion,   tenure,    and  salary  increases.     Any  program  of  faculty  evalua- 
tion that  employs  the  sole  use  of  student  ratings  very  likely  is  not  pro- 
viding adequate  information  on  faculty  teaching  performance  and  may 
lead  to  erroneous  personnel  decisions. 

One  last  recommendation  is  appropriate  for  the  results  of  this 
study.     The  adjectives  identified  in  this  study  provide  a  clearer  picture 
of  the  high  expressive  teaching  style.     This  style  has  been  shown  to 
influence  positively  student  ratings  and  student  achievement.     Thus, 
faculty  development  programs  could  develop  specific  training  programs 
in  teaching  style  for  college  professors  based  on  the  adjectives  identi- 
fied in  this  study. 

These  adjectives  are  lecturer  characteristics,    and  if  converted 
into  the  systematic  observation  instrument  mentioned  above,    would  pro- 
vide an  excellent  source  of  feedback  to  aid  college  professors  to  improve 
their  teaching  style.      The  behaviors  associated  with  these  adjectives 
might  be  taught  to  professors,    and  thus  have  the  potential  for  improving 
their  classroom  presentations.      This  is  important  since  these  highly 
expressive  teaching  behaviors  identified  by  the  adjectives  have  an  im- 
pact on  student  learning  growth.     Since  part  of  the  goal  of  teaching  is  to 
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have  an  impact  on  student  learning,    these  behaviors  are  likely  to  aid 
professors  in  their  attempts  to  foster  student  learning. 

In  summary,    the  two  practical  recommendations  growing  out  of 
the  results  of  this  study  are  the  follow^ing: 

1.  A  restructuring  of  faculty  evaluation  and  reward  procedures 
into  a  multiple  data  approach  using  systematic  observation  procedures, 
student  ratings  of  instruction,    and  student  achievement  gain  scores  as 
the  basis  for  evaluation  of  faculty  teaching  performance. 

2.  An  addition  to  faculty  development  programs  of  a  program  to 
teach  the  high  expressive  teaching  behaviors  associated  with  the  Doctor 
Fox  effect  to  college  professors,    so  that  the  faculty  of  colleges  and 
universities  can  improve  their  teaching  style  and  have  a  greater  innpact 
on  student  learning. 


APPENDIX  A 
Administration  Directions 


ADMINISTRATION  DIRECTIONS 
Good  morning.     My  name  is  Howard  Ramagli.      This  morning  I  would 
like  to  ask  you  to  help  me.     In  an  effort  to  develop  new  ways  of  provid- 
ing learning  experiences  for  students,    we  are  field  testing  some  \-ideo- 
taped  lectures  as  possible  supplementary  material  for  introductory 
classes  in  the  area  of  psychology.      The  specific  lectures  we  are  testing 
are  on  the  biochemistry  of  memory.     What  we  are  asking  you  to  do  to- 
day is  to  help  us  evaluate  the  quality  of  lecturing  in  these  videotaped 
lectures.      You  will  be  shown  two  segments  of  tapings  of  a  lecture  on 
the  biochemistry  of  memory.     After  you  view  each  lecture  segment, 
you  will  be  asked  to  evaluate  the  quality  of  lecturing  in  that  particular 
segment.      Let  me  repeat  this.     I  will  show  you  a  segment  of  Lecture  A 
and  then  I  will  ask  you  to  evaluate  the  quality  cf  lecturing  in  that  seg- 
ment.    I  will  then  show  you  a  segment  of  Lecture  B  and  you  will  be 
asked  to  evaluate  the  quality  of  lecturing  in  that  particular  segment. 
Are  there  any  questions   so  far?     Please  open  to  page  1  of  your  booklet. 
The  evaluations  we  are  collecting  from  you  will  be  kept  confidential, 
however,    we  do  need  some  descriptive  information  on  you  as  a  group. 
This  informiation  will  also  be  kept  confidential.     Would  you  please  fill 
in  the  information  requested  on  page  1.     When  you  have  finished,    please 
do  not  turn  the  page.      PJease  look  up  at  me  to  indicate  you  have  finished. 
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PAGE    2 
(Filling  out  of  descriptive  information) 
Is  everyone  finished? 


Now  that  all  of  you  are  finished,    we  will  begin.     We  will  start  with  a  seg- 
ment from  Lecture  A.      (TURN  ON  VIDEOTAPE)     This  is   Lecture  A. 


(Viewing  of  Lecture  A) 
Please  turn  to  page  2  in  your  booklet.      This  is  the  evaluation  form  we 
v/ould  like  for  you  to  fill  out  for  Lecture  A.      (READ  INSTRUCTIONS) 
(Discuss  items   1  and  8,    explaining  their  five  choices  to  circle)     Please 
respond  to  all  of  these  items  on  pages  2  and  3.      Please  begin.      When 
you  have  finished,    please  do  not  turn  the  page.      Please  look  up  at  nne  to 
indicate  you  have  finished. 


(Rating  of  Lecture  A) 
Is  everyone  finished? 


Now  that  you  all  are  finished,    we  will  continue.     We  will  now  see  a  seg- 
ment from  Lecture  B.      (TURN  ON  VIDEOTAPE)     This  is  Lecture  B. 


(Viewing  of  Lecture  B) 
Please  turn  to  page  4  in  your  booklet.      This  is  the  evaluation  form  for 
Lecture  B.     It  is  the  same  form,  you  filled  out  for  Lecture  A.      Please 
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PAGE    3 
complete  this  form.      Please  respond  to  all  of  these  items.     When  you 
have    finished,    please  do  not  turn  the  page.      Please  look  up  at  me  to 
indicate  vou  have  finished. 


(Rating  of  Lecture  B] 
Is  everyone  finished? 


Now  that  you  have  finished,    please  turn  to  page  6.      The  instructions  ask 
you  to  select  which  of  the  two  lecture  segments  you  saw  was  the  better 
lecture  presentation.      Please  place  a  check  in  the  box  below  either  Lec- 
ture A  or  Lecture  B.     Please  do  not  check  them  both.     When  you  have 
finished,    please  look  up  at  me. 


(Completing  Choice  Variable  Page) 
Please  turn  to  page  7.     On  this  page  you  will  find  a  list  of  adjectives. 
Please  read  the  instructions  carefully.      They  ask  you  to  select  those 
adjectives,    characteristic  of  the  instructor,    which  were  influential  in 
your  choice  of  which  lecture  presentation  was  better.      Please  place  a 
check  on  the  line  to  the  left  of  each  adjective,    characteristic  of  the  lec- 
turer,   which  was  influential  in  your  choice  of  the  lecture  segment  you 
chose.      You  may  select  as  many  or  as  few  adjectives  as  you  choose. 
When  you  have  finished,    please  look  up  at  me. 


(Completing  of  Adjective  Checklist) 
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PAGE   4 
Now  that  you  have  finished,    please  pass  your  booklets  forward.      I  would 
like  to  thank  each  of  you  for  your  help.     We  will  be  condu.cting  this  eval- 
uation with  a  number  of  classes  in  the  College  of  Education.     In  an  ef- 
fort to  get  the  honest  opinion  of  all  of  those  individuals  we  will  be  asking 
to  evaluate  the  videotapes,    we  ask  you  please,    do  not  discuss  what  you 
have  done  or  seen  with  anyone  outside  of  this  class.      This  is  most  im- 
portant if  we  are  to  get  an  honest  evaluation  of  the  quality  of  these  video- 
tapes.    1  will  be  glad  to  come  back,    if  you  are  interested,   toward  the 
end  of  the  quarter  and  provide  you  with  feedback  as  to  the  results  of 
these  evaluations.     Thank  you  for  helping  me. 


APPENDIX  B 
High  Content  Lecture  Script 


THE  DR.    FOX  LECTURE  OF  THE  BIOCHEMISTRY  OF  MEMORY* 

HIGH  CONTENT  LEVEL 


These  days,    educators  in  America  talk  a  great  deal  about  the  in- 
novative hardware  of  education,    about  computer -assisted  instruction, 
8m.m  cartridge-loading  projectors,    microtransparencies,    and  other  de- 
vices.     The  emphasis  is  on  devices,    but  tomorrow?     Well,    in  the  not 
too  distant  future  they  may  well  be  talking  about  enzyme-assisted  in- 
struction,   protein  memory  consolidators,    antibiotic  nnemory  repellers, 
and  the  chemistry  of  the  brain.      That  may  be  the  phrase  of  the  future-- 
the  chemistry  of  the  brain.     Although  the  psychologists'  learning  theo- 
ries derived  from  the  study  of  m.aze-running  rats  or  target-pecking 
pigeons  have  failed  to  provide  insights  into  the  education  of  children, 
there  is  nothing  wrong  with  learning  theory--it's  just  inadequate.     It  is 
unlikely,    very  unlikely,    that  what  is  now  being  discovered  by  the  psy- 
chologist,   chemist,    and  neurophysiologist  about  rat-brain  chemistry 
can  deviate  widely  from  what  we  will  eventually  discover  about  the  chem- 
istry of  the  human  brain. 

Consider  this  example,    most  adults,    (even  college  professors 
who  are  not  senile)  can  repeat  a  series  of  seven  numbers--8,    4,    8,    8, 
3j    9,    9- -immediately  after  the  series  is   read.      If,    however,    they  are 


*From  Ware  (1974),    pp.    168  -  170. 

94 


95 

asked  to  repeat  these  numbers  thirty  minutes  later,    most  will  fail 
(including  even  the  college  professor--most  will  fail.  )    Now  in  the  first 
instance,    we  are  dealing  with  the  immediate  memory  span;    and  in  the 
second,    with  long-term  memory.      These  basic  behavioral  observations 
lie  behind  what  is  called  the  two-stage  process  theory. 

According  to  a  common  variant  of  these  notions,    immediately 
after  every  learning  trial--indeed,    after  every  experience--a  short- 


lived  electrochemical  process  is  established  in  the  brain.      This  process, 
so  goes  the  assumption,    is  the  physiological  mechanism  which  carries 
the  short-term  memory.     Within  a  few  seconds  or  minutes,    however, 
this  process  decays  and  disappears;    but  before  doing  so,    if  all  systems 
are  go,    the  short-term  electrochemical  process  triggers  a  second  se- 
ries  of  events  in  the  brain.      This  second  process  is  chemical  in  nature 
and  involves,    primarily,    the  production  of  new  proteins  and  the  induc- 
tion of  higher  enzymatic  activity  levels  in  the  brain  cells.      This  process 
is  more  enduring  and  serves  as  the  physiological  substrate  of  our  long- 
term  memory. 

It  would  follow  that  one  approach  to  testing  our  theory  would  be  to 
provide  a  subject  with  some  experience  or  other,    then  interrupt  the 
short-term  electrochemical  process  immediately--before  it  has  had  an 
opportunity  to  establish  the  long-term  process.      If  this  were  done,    our 
subject  should  never  develop  a  long-term  memory  for  that  experience. 

Now  at  the  Albert  Einstein  Medical  School  in  New  York,    Dr. 
Murray  Jarvik  has  devised  a  "step-down"  procedure  based  on  the  fact 
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that  when  a  rat  is  placed  on  a  small  platform  a  few  inches  above  the 
floor,    the  rat  will  step  down  onto  the  floor  within  a  few  seconds.     Now 
the  rat  will  do  this  consistently,    day  after  day.     Suppose  that  on  one  day 
the  floor  is  electrified,    and  stepping  onto  it  produces  a  painful  shock. 
When  the  rat  is  afterward  put  back  on  the  platform- -even  twenty-four 
hours  later--it  will  not  budge  from  the  platform;    it  will  remain  there 
until  the  experimenter  gets  tired  and  calls  the  experiment  quits.      That 
rat  has  thus  demonstrated  that  he  has  a  long-term  memory  for  that 
painful  experience. 

Now,    if  we  take  another  rat,    but  this  time  interfere  with  his 
short-term  memory  process  immediately  after  he  has   stepped  onto  the 
electrified  floor,    the  rat  should  show  no  evidence  of  having  experienced 
a  shock  when  tested  the  next  day,    since  we  have  not  given  his   short- 
term  electrochemical  memiory  process  an  opportunity  to  initiate  the 
long-term  protein-enzynnatic  process.      To  interrupt  the  short-term 
process,    Jarvik  passes  a  mild  electric  current  across  the  brain  of  the 
animal.     Now,    the  current  is  not  strong  enough  to  cause  irreparable 
harm  to  the  brain  cells,    but  it  does  result  in  a  very  high  level  of  acti- 
vation of  the  neurons  in  the  brain,    thus  disrupting  the  short-term  elec- 
trochemical memory  process.      If  this  treatment  follows  closely  enough 
after  the  animal's  first  experience  with  the  foot  shock,    and  we  test  the 
rat  a  day  later,    the  rat  acts  as  if  there  were  no  memory  for  yesterday's 
event;    the  rat  jauntily  and  promptly  steps  down  from  the  platform  with 
no  apparent  expectation  of  shock. 


APPENDIX  C 
Low  Content  Lecture  Script 


THE  DR.    FOX  LECTURE  ON  THE  BIOCHEMISTRY  OF  JvIEMORY' 

LOW  CONTENT  LEVEL 


These  days,    educators  in  America  are  talking  a  great  deal  about 
the  innovative  hardware  of  education,    computer-assisted  instruction, 
8mm  cartridge  loading  projectors,    microtransparencies,    and  other  de- 
vices.    In  the  not  too  distant  future  they  may  well  be  talking  about 
enzyme-assisted  instruction,    protein  memory  consolidators,    antibiotic 
memory  repellers,    and  the  chemistry  of  the  brain.      The  chemistry  of 
the  brain- -perhaps  the  phrase  of  the  future.     Although  the  psychologists' 
learning    theories  derived  from  the  study  of  maze-running  rats  or 
target-pecking  pigeons  have  failed  to  provide  insights  into  the  education 
of  children,    there  is  nothing  wrong  with  learning  theory.     It  is  just  in- 
adequate.    It  is  unlikely  that  what  is  now  being  discovered  by  the  psy- 
chologist,   the  chemist,    the  neurophysiologist  about  rat-brain  chemistry 
can  deviate  widely  from  what  we  will  eventually  discover  about  the 
chemistry  of  the  human  brain. 

The  data  is  not,    however,    restricted  to  findings  from  studies  of 
sub-human  animals.     We  have  some  very  convincing  direct  and  indirect 
evidence  from  studies  of  humans  as  well  as  clinical  reports  which,    in 
some  cases  parallel  the  findings  from  animal  laboratories  very  closely. 


*From  Ware  (1974),    pp.    146  -   148. 
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I  will  have  more  to  say  about  this  later.     I  especially  want  to  take  a 
moment  later  to  stress  what  I  believe  is  a  very  important  point,    namely, 
the  necessity  of  confirmation  of  experimental  results.      That  is,    we 
must  proceed  very  cautiously  until  controversial  findings  from  a  given 
investigator's  laboratory  are  also  reported  by  at  least  another  scientist 
using  the  same  methodology.     Secondly,    I  feel  we  must  have  some  indi- 
cation or  strong  trend  suggesting  that  there  is  comparability  between 
processes  in  animals  and  the  implications  of  the  process  before  we 
start  yelling  from  the  rooftops,    so  to  speak.      Therefore,    I  have  chosen 
to  focus  on  those  teaching  points  in  this  lecture  which  relate  to  the  work 
of  a  number  of  investigators.     When  there  is  question,    I  will  call  that  to 
your  attention.     When  there  is  parallel  data  from  direct  and  indirect 
evidence  gathered  regarding  humans,    I  will  call  that  to  your  attention. 
Although  summaries  are  uniquely  difficult  in  such  a  complicated  area 
as  this  with  results  which  are  difficult  to  digest,    I  will  try  to  put  a  handle 
on  it  all  for  you. 

Now,    as  much  as  one  might  be  inclined  to  assume  that  it  is  obvi- 
ous what  we  mean  when  we  say  "memory"  let  me  be  simplistic  and  go 
over  an  example.     Most  adults,    except  those  who  are  senile,    (including 
even  college  professors,  )  can  repeat  a  series  of  seven  numbers  8,    4,    8, 
8,    3,    9,    9  immediately  after  the  series  is  read.     If,    however,    they  are 
asked  to  repeat  these  numbers  later,    most,    (including  the  college  pro- 
fessors, )  will  fail.     As   sim.ple  and  as  obvious  as  this  example  may 
seem  it  says  sonnething  very  important  about  the  process  of  memory 
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and  the  kinds  of  functions  it  serves.  Evidence  of  the  importance  placed 
on  the  ability  to  retain  digits  and  the  differences  which  exist  in  people's 
ability  to  make  such  retentions  is  found  by  analyzing  current  intelli- 
gence tests.  Now,  it  is  beyond  the  scope  of  this  first  lecture  in  the 
series  to  go  into  the  very  interesting  theoretical  and  empirical  work  on 
the  relationship  between  memory  and  intelligence  but,  suffice  it  to  say, 
for  purposes  of  my  point,    that  memory  span  may  be  an  important  aspect 

of  I.Q. 

So  what  have  I  said?     I  have  used  a  simple  example  to  make  the 
point  that  memory  is  a  process.     However,    one  should  not  be  ready  to 
accept  the  notion  that  the  word  process  in  any  way  gives  us  some  magic 
insight  into  the  intricate  complexities  of  what  that  word  so  easily  encom.- 
passes.     As  you  will  see  from  the  studies  I  will  cite,    one  must  carefully 
work  with  the  subtle  aspects  of  the  processes  in  order  to  tease  out  an 
understanding  of  the  relationships  which  are  involved. 

Still  another  problem  is  the  terminology  employed  in  the  study  of 
memory  which,    like  many  other  areas  of  science,    is  unique  and  holds 
little  in  common  with  the  ways  in  which  the  vocabulary  generally  applies. 
For  example,    so-called  "stages"  of  m.emory  are  often  discussed  in  the 
literature  of  the  biological  sciences  as  well  as  in  the  psychology  litera- 
ture.    These  stages  have  been  referred  to  by  a  variety  of  names--how- 
ever,    I  want  you  to  know  that  regardless  of  the  terminology  employed, 
the  concepts  are  basically  the  same. 


APPENDIX    D 
LECTURE     EVALUATION     BOOKLET 


PART  I.     DIRECTIONS:     Please  do  not  write  your  name  anywhere  on 
this  questionnaire.     We  want  you  to  feel  free  to  respond  honestly  and 
frankly.     However,    for  statistical  purposes  we  need  to  know  a  few  things 
about  you.      These  data  will  be  analyzed  on  a  group  basis. 


1.     What  is  your  age  (in  years] 


9 


Z.     What  is  your  sex?    Female    Male 

3.  Circle  the  highest  grade  you  have  completed  during  your 
schooling. 

9      10      11      12  13      14      15      16  17      18      19      20 

High  School  College  Post  graduate 

4.  Mark  the  one  category  which  best  represents  your  overall 
undergraduate  GPA    (4.  0  =  A). 

3.  6  to  4.  0  2.  1  to  2.  5 

3.  1  to  3.  5  1.  0  to  2.  0 

2.  6  to  3.  0 


5.  What  is  your  academic  classification  (for  example,    lUF)? 

6.  What  is  your  present  academic  major? 


STOP! 
PLEASE  DO  NOT  GO  TO  PAGE  2  UNTIE  TOLD  TO  DO  SO. 
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PART  11.      LECTURE  A  Lecturer  Evaluation.     DIRECTIONS:     Below  you 
will  find  a  series  of  statements  about  the  lecturer  in  the  videotape  you 
just  saw.      Please  read  each  statement  carefully,    and  respond  to  each 
using  the  following  scale: 

E  -  Exceptional  perfornnance 
V  -  Very  good  performance 
G  -  Good  performance 
W  -  Weak  performance 
I  -  Improvement  definitely  needed 

Indicate  your  response  to  each  statement  by  circling  the  corresponding 
code  to  the  left  of  the  statement  number. 

THE  LECTURER: 

I         1.     Spoke  understandably. 

2.  Knew  if  students  understood  him. 

3.  Showed  an  interest  ia  students. 
I        4.     Increased  your  appreciation  for  the  subject. 

5.  In  general,    taught  effectively. 

6,  Gave  several  examples  to  explain  complex 
ideas. 

E         V        G         W         I        7.     Knew  his  subject  matter. 

PART  HA.     DIRECTIONS:     Below  you  will  find  another  series  of  state- 
ments about  the  lecturer  in  the  videotape  you  just  saw.      Please  read 
each  statement  carefully,    and  respond  to  each  using  the  following  scale: 

SA  -  I  strongly  agree  with  the  statement 

A  -  I  agree  with  the  statement 

N  -  Neutral,    I  neither  agree  nor  disagree 

D  -  I  disagree  with  the  statement 
SD  -  I  strongly  disagree  with  the  statement 

Indicate  your  response  to  each  statement  by  circling  the  correspor.'ling 
code  to  the  left  of  the  statement  number. 


PLEASE  GO  ON  TO  PAGE  3 
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V 

G 

w 

E 

V 

G 

w 
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THE  LECTURER: 

SA        AND        SD        8,     Stressed  important  material. 

SA        AND        SD         9.     Was  an  effective  lecturer. 

SA        AND         SD      10.      Has  a  good  sense  of  humor. 

SA        AND        SD      11.     Organized  and  presented  subject  nnatter 

well. 

SA        AND        SD      12.     Inspired  confidence  in  his  knowledge  of 

the  subject. 

SA  AND  SD  13.  Broadened  my  interest  in  the  subject. 

SA  AND  SD  14.  Explained  the  subject  clearly. 

SA  AND  SD  15.  Increased  my  knowledge  of  the  subject. 

SA  A        N        D  SD  16.  Stimulated  my  thinking. 

SA  AND  SD  17.  Was  enthusiastic  about  the  subject. 

SA  AND  SD  18.  Made  learning  enjoyable. 


STOP! 
PLEASE  DO  NOT  GO  TO  PAGE  4  UNTIL  TOLD  TO  DO  SO 
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PART  III.      LECTURE  B     Lecturer  Evaluation.     DIRECTIONS:     Below 
you  will  find  a  series  of  statements  about  the  lecturer  in  the  videotape 
you  just  saw.      Please  read  each  statement  carefully,    and  respond  to 
each  using  the  following  scale: 

E  -  Elxceptional  performance 
V  -   Very  good  performance 
G  -  Good  performance 
W  -  Weak  performance 
I   -  Improvement  definitely  needed 

Indicate  your  response  to  each  statement  by  circling  the  corresponding 
code  to  the  left  of  the  statement  number. 

THE  LECTURER: 

E         V        G        W         I        1.     Spoke  understandably. 

E         V        G        W        I        2.     Knew  if  students  understood  him. 

E         V        G        W         I        3.     Showed  an  interest  in  students. 

E         V        G        W         I        4.     Increased  your  appreciation  for  the  subject. 

E         V        G        W        I         5.     In  general,    taught  effectively. 

E         V        G        W        I        6.     Gave  several  examples  to  explain  complex 

ideas. 

E         V        G         W         I        7.     Knew  his  subject  matter. 

PART  IIIA.      DIRECTIONS:     Below  you  will  find  another  series  of  state- 
ments about  the  lecturer  in  the  videotape  you  just  saw.     Please  read 
each  statement  carefully,    and  respond  to  each  using  the  following  scale: 

SA  -  I  strongly  agree  with  the  statement 

A  -  I  agree  with  the  statement 

N  -  Neutral,    I  neither  agree  nor  disagree 

D  -  I  disagree  with  the  statement 
SD  -  I  strongly  disagree  with  the  statement 

Indicate  your  response  to  each  statement  by  circling  the  corresponding 
code  to  the  left  of  the  statement  number. 


PLEASE  GO  ON  TO  PAGE  5 
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THE  LECTURER: 

SA        A        N        D        SD        8.     Stressed  important  material, 

SA        AND        SD        9.     Was  an  effective  lecturer. 

SA        AND        SD      10.     Has  a  good  sense  of  humor. 

SA        AND        SD      11.     Organized  and  presented  subject  matter 

well. 

SA        AND        SD      12.     Inspired  confidence  in  his  knowledge  of 

the  subject. 

N  D  SD  13.  Broadened  my  interest  in  the  subject. 

N  D  SD  14.  Ebcplained  the  subject  clearly. 

N  D  SD  15.  Increased  my  knowledge  of  the  subject. 

N  D  SD  16.  Stimulated  my  thinking. 

N  D  SD  17.  Was  enthusiastic  about  the  subject. 

N  D  SD  18.  Made  learning  enjoyable. 


SA 

A 

SA 

A 

SA 

A 

SA 

A 

SA 

A 

SA 

A 

STOP! 
PLEASE  DO  NOT  GO  TO  PAGE  6  UNTIL  TOLD  TO  DO  SO 
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PAUT  IV.      LECTURE  CHOICE.    DIRECTIONS:     Below  you  will  find 
Lecture  A  and  Lecture  B  listed  with  a  box  below  each  of  them.      Please 
place  a  check  in  the  box  below  the  lecture  which  you  feel  was  the  better 


lecture  presentation  by  the  lecturer. 
boxes  below. 


Please  check  only  one  of  the 


LECTURE  A 


LECTURE  B 


U 


STOP! 


PLEASE  DO  NOT  GO  TO  PAGE  7  UNTIL  TOLD  TO  DO  SO 
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PART  V.     LECTURER  ADJECTIVE  CHECKLIST.    DIRECTIONS:     Below 
is  a  list  of  adjectives.      Please  place  a  check  to  the  left  of  those  adjec- 
tives,   characteristic  of  the  instructor,    which  were  influential  in  your 
choice  of  either  Lecture  A  or  Lecture  B  as  the  better  lecture  presenta- 
tion. 


Dramatic 
Knowledgable 
Thorough 
Coherent 


_Well -prepared 
_Energetic 

Logical 

Explanatory 
_Inspiring 

Understandable 
_Well-paced 

Expressive 
_Forceful 
_Int  ere  sting 

Variety 

Stimulating 


_Interested 

Warm 
_Scholarly 

Orderly 

Seductive 

Stylized 
_Motivating 

Masterful 

Enthusiastic 

Showmanship 

Vital 


Concise 

Lucid 
Enjoyable 
Clear 
Inventive 


_Cultured 

_Confident 

_Poised 

_Humorous 

_Sparkling 

_Competent 

_Charismatic 

_Conscientious 

_Dynamic 

_Well- groomed 

Organized 

Carefvd 

Witty 

Unique 

Persuasive 


APPENDIX    E 
ADJECTIVE  FREQUENCY  DISTRffiUTION  FOR 
LECTURE  CHOICE  VARIABLE 


Table  El 


Sample  Population  Frequency  Distribution  for  Adjective 
Choice/No  Choice  across  Lecture  Type  for  the  Lecture  Choice  Variable 


Lecture  Type* 


*=.-  Dramatic 


Well- Prepared 


Choice  Condition  HC-HE  HC-LE  LC-HE  LC-LE 


No  choice 

63 

52 

48 

38 

freq.    % 

22.7 

18.8 

17.  3 

13.7 

Choice 

29 

2 

44 

1 

freq.    % 

10.5 

0.7 

15.9 

0.4 

**  Knowledgeable 

No  choice 

31 

26 

56 

15 

freq.    % 

11.2 

9.4 

20,2 

5.4 

Choice 

61 

28 

36 

24 

freq.    % 

22.  0 

10.  1 

13.0 

8.7 

Thorough 

No  choice 

71 

44 

78 

27 

freq.    % 

25.6 

15.9 

28.2 

9.8 

Choice 

21 

10 

14 

12 

freq.    % 

7.6 

3.6 

5.0 

4.3 

Coherent 

No  choice 

61 

35 

72 

24 

freq.    % 

22.0 

12.6 

26.0 

8.7 

Choice 

31 

19 

20 

15 

freq.   % 

11.2 

6.9 

7.2 

5.4 

No  choice 

44 

28 

56 

18 

freq.    % 

15.9 

10.  1 

20.2 

6.5 

Choice 

48 

26 

36 

21 

freq.    % 

17.3 

9.4 

13.  0 

7.6 
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HI 


Table  El   (Cont'd.  ) 


Lecture  Type^ 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

**  Energetic 

No  choice 

25 

50 

30 

35 

freq.    % 

9.0 

18.  1 

10.8 

12.6 

Choice 

67 

4 

62 

4 

freq.    % 

24.2 

1.4 

22.4 

1.4 

**  Logical 

No  choice 

64 

32 

76 

22 

freq.    % 

23.1 

11.6 

27.4 

7.9 

Choice 

28 

22 

16 

17 

freq.    % 

33.7 

26.  5 

19.3 

20,  5 

Explanatory 

No  choice 

42 

30 

57 

16 

freq.    % 

15.2 

10.8 

20.  6 

5.8 

Choice 

50 

24 

35 

23 

freq.    % 

37.9 

18.2 

26.  5 

17.2 

**  Inspiring 

No  choice 

77 

51 

70 

39 

freq.    % 

27.8 

18.4 

25.3 

14.  1 

Choice 

15 

3 

22 

0 

freq.    % 

5.4 

1.  1 

7.9 

0.0 

Understandable 

No  choice 

36 

27 

49 

20 

freq.    % 

13.0 

9.7 

17.7 

7.2 

Choice 

56 

27 

43 

19 

freq.    % 

20.2 

9.7 

15.  5 

6.9 
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Table  El   (Cont'd. 


Lecture 

Type* 

Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Well-Paced 

No  choice 

69 

35 

57 

25 

freq  % 

24.9 

12.6 

20.6 

9.0 

Choice 

23 

19 

35 

14 

freq.    % 

25.3 

20.  9 

38.5 

15.4 

**  Elxpressive 

No  choice 

40 

46 

43 

36 

freq.    % 

14.4 

16.6 

15.5 

13.0 

Choice 

52 

8 

49 

3 

freq.    % 

18.8 

2.9 

17.7 

1.1 

**  Forceful 

No  choice 

62 

54 

72 

38 

freq.    % 

22.4 

19.5 

26.  0 

13.7 

Choice 

30 

0 

20 

1 

freq.    % 

10.8 

0.  0 

7.2 

0.4 

**  Interesting 

No  choice 

53 

46 

67 

36 

freq.    % 

19.1 

16.6 

24.2 

13.0 

Choice 

39 

8 

25 

3 

freq.    % 

14.  1 

2.9 

9.0 

4.0 

Variety- 

No  choice 

82 

51 

83 

37 

freq.    % 

29.6 

18.4 

30.0 

13.4 

Choice 

10 

3 

9 

2 

freq.    % 

3.6 

1.  1 

3.2 

0.7 
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Table  El   (Cont'd.  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-T,E 

LC-HE 

LC-LE 

**  Stimulating 

No  choice 

62 

52 

75 

38 

freq.    % 

22.4 

18.8 

27.  1 

13.7 

Choice 

30 

2 

17 

1 

freq.    % 

10.8 

0.7 

6.1 

0.4 

**  Interested 

No  choice 

54 

46 

59 

30 

freq.    % 

19.5 

16.  6 

21.3 

10.8 

Choice 

38 

8 

33 

9 

freq.    % 

13.7 

2.9 

11.9 

10.2 

**  Warm 

No  choice 

70 

51 

74 

38 

freq.    % 

25.3 

18.4 

26.7 

13.7 

Choice 

22 

3 

18 

1 

freq.    % 

7.9 

1.  1 

6.  5 

0.4 

Scholarly 

No  choice 

69 

38 

74 

25 

freq.    % 

24.9 

13.7 

26.7 

9.  0 

Choice 

23 

16 

18 

14 

freq.    % 

8.3 

5.8 

6.5 

19.7 

**  Orderly 

No  choice 

67 

27 

74 

21 

freq.    % 

24.2 

9.7 

26.7 

7.6 

Choice 

25 

27 

18 

18 

freq.    To 

9.0 

9.7 

6.5 

6.  5 
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Table  El   (Cont'd.  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Stylized 

No  choice 

90 

50 

83 

38 

freq.    % 

32.5 

18.1 

30.0 

13.7 

Choice 

Z 

4 

9 

1 

freq.    % 

0.7 

1.4 

3.2 

0.4 

**  Motivating 

No  choice 

62 

53 

76 

37 

freq.    % 

22.4 

19.1 

27.4 

13.4 

Choice 

30 

1 

16 

2 

freq.    % 

10.8 

0.4 

5.8 

0.7 

Masterful 

No  choice 

83 

48 

82 

37 

freq.    % 

30.  0 

17.3 

29.6 

13.4 

Choice 

9 

6 

10 

2 

freq.    % 

3.2 

22.2 

37.  0 

0.7 

**  Enthusiastic 

No  choice 

27 

52 

39 

38 

freq.    % 

9.7 

18.8 

14.2 

13.7 

Choice 

65 

2 

53 

1 

freq.    % 

23.5 

0.7 

19.1 

0.4 

**  Showmanship 

No  choice 

78 

54 

82 

38 

freq.    % 

28.2 

19.5 

29.6 

13.7 

Choice 

14 

0 

10 

1 

freq.    % 

5.1 

0.0 

3.6 

0.4 
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Table  El   (Cont'd. 


Lecture  Type-- 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Vital 

No  choice 

85 

53 

86 

39 

freq,    % 

30.7 

19.1 

31.  1 

14.  1 

Choice 

7 

1 

6 

0 

freq.    % 

2.5 

0.4 

Z.2 

0.  0 

Concise 

No  choice 

77 

41 

80 

28 

freq.    % 

27.8 

14.8 

28.  9 

10.  1 

Choice 

15 

13 

12 

11 

freq.    % 

5.4 

4.7 

4.3 

21.6 

Lucid 

No  choice 

86 

51 

89 

37 

freq.    % 

31.1 

18.4 

32.  1 

13.4 

Choice 

6 

3 

3 

2 

freq.    % 

2.2 

1.  1 

1.  1 

0.7 

**  Enjoyable 

No  choice 

64 

51 

67 

37 

freq.    % 

23.1 

18.4 

24.2 

13.4 

Choice 

28 

3 

25 

2 

freq.    % 

10.  1 

1.  1 

9.0 

0.7 

Clear 

No  choice 

45 

30 

52 

18 

freq.    % 

16.2 

10.8 

18.8 

6.5 

Choice 

47 

24 

40 

21 

freq.    % 

17.  0 

8.7 

14.4 

7.6 
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Table  El   (Cont'd.  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Inventive 

No  choice 

85 

53 

84 

38 

freq.    % 

30.7 

19.  1 

30.3 

13.7 

Choice 

7 

1 

8 

1 

freq.    % 

2.5 

0.4 

2.9 

0.4 

Cultured 

No  choice 

89 

50 

88 

33 

freq.    % 

3Z.1 

18.  1 

31.8 

11.9 

Choice 

3 

4 

4 

6 

freq.    % 

1.1 

23.  5 

23.  5 

35.3 

Confident 

No  choice 

44 

37 

48 

21 

freq.    % 

15.9 

13.4 

17.  3 

7.6 

Choice 

48 

17 

44 

18 

freq.    % 

17.3 

6.1 

15.9 

6.5 

Poised 

No  choice 

67 

45 

77 

29 

freq.    % 

24.2 

16.2 

27.8 

10.  5 

Choice 

25 

9 

15 

10 

freq.    % 

42.4 

3.2 

25.4 

17.  0 

**  Humorous 

No  choice 

48 

50 

49 

38 

freq.    % 

17.3 

18.1 

17.7 

13.7 

Choice 

44 

4 

43 

1 

freq.    % 

15.9 

1.4 

15.  5 

0.4 
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Table  El   (Cont'd,  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

'■''■■■'•  Soarkling 

No  choice 

74 

53 

78 

38 

freq,    % 

26.7 

19.  1 

28,2 

13,7 

Choice 

18 

1 

14 

1 

freq.    % 

6.5 

0,4 

5.  1 

0.4 

Competent 

No  choice 

59 

38 

72 

30 

freq. 

21,3 

13.7 

26.  0 

10.8 

Choice 

33 

16 

20 

9 

freq.    % 

11.9 

5,8 

7.2 

3.2 

Charismatic 

No  choice 

84 

54 

85 

39 

freq.    %' 

30.3 

19.5 

30,7 

14.2 

Choice 

8 

0 

7 

0 

freq.    % 

2.9 

2.  5 

0.0 

Conscientious 

No  choice 

84 

50 

85 

34 

freq.    % 

30.  3 

18,  1 

30.7 

12.3 

Choice 

8 

4 

7 

5 

freq,    % 

2.9 

1,4 

2,  5 

1.8 

::=*  Dynamic 

No  choice 

69 

54 

80 

39 

freq.    % 

24.9 

19.5 

28.9 

14.  1 

Choice 

23 

0 

12 

0 

freq.    % 

8,  3 

0,0 

4.3 

0.0 
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Table  El    (Cont'd. 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Well-Groomed 

No  choice 

78 

47 

78 

33 

freq.    % 

28.2 

17.0 

28.2 

11.9 

Choice 

14 

7 

14 

6 

freq.    % 

5.  1 

2.5 

5.  1 

2.2 

Organized 

No  choice 

50 

25 

49 

17 

freq.    % 

18.1 

9.0 

17.7 

6.1 

Choice 

42 

29 

43 

22 

freq.    % 

15.2 

10.  5 

15.  5 

7.9 

Careful 

No  choice 

86 

45 

87 

34 

freq.    % 

31.1 

16.2 

31.4 

12.3 

Choice 

6 

9 

5 

5 

freq.    % 

2,2 

3.2 

1.8 

1.8 

**  Witty 

No  choice 

64 

52 

69 

38 

freq.    % 

23.1 

18.8 

24.9 

13.7 

Choice 

28 

2 

23 

1 

freq.    % 

10.  1 

0.7 

8.3 

0.4 

Unique 

No  choice 

83 

54 

84 

35 

freq.    % 

30.0 

19.  5 

30.3 

12.6 

Choice 

9 

0 

8 

4 

freq.    % 

3.2 

0.  0 

2.9 

1.4 
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Table  El    (Cont'd. 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

**  Persuasive 

No  choice 

76 

54 

82 

36 

freq.    % 

27.4 

19.5 

29.6 

13.0 

Choice 

16 

0 

10 

3 

freq.    % 

5.8 

0.0 

3.6 

1.  1 

*  HC  -  High  Content 
LC  -   Low  Content 
HE  -  High  Expressiveness 
LE  -   Low  Ebcpressiveness 
=  *  X''  significant  at  p  <  .  01   for  3  degrees  of  freedom 


APPENDIX  F 

ADJECTIVE  FREQUENCY  DISTRIBUTION  FOR 

RATING  CHOICE  VARIABLE 


Table  Fl 

Sample  Population  Frequency  Distribution  for  Adjective 
Choice/No  Choice  across  Lecture  Type  for  the  Rating  Choice  Variable 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

-*  Dramatic 

No  choice 

62 

48 

43 

37 

freq.    % 

23.5 

18.2 

16.3 

14.  0 

Choice 

27 

6 

40 

1 

freq.    % 

10.2 

2.3 

15.  1 

0.4 

**  Knowledgeable 

No  choice 

30 

28 

48 

13 

freq.    % 

11.4 

10.6 

18.  2 

4.9 

Choice 

59 

26 

35 

25 

freq.    % 

22.3 

9.8 

13.  3 

9.5 

Thorough 

No  choice 

67 

45 

69 

26 

freq.    % 

25.4 

17.0 

26.1 

9.8 

Choice 

22 

9 

14 

12 

freq.    % 

8.3 

15.8 

24.  6 

21.0 

Coherent 

No  choice 

60 

36 

62 

24 

freq.    % 

22.7 

13.6 

23.5 

9.1 

Choice 

29 

18 

21 

14 

freq.    % 

11.  0 

6.8 

8.0 

5.3 

Well-Prepared 

No  choice 

43 

29 

46 

19 

freq.    % 

16.3 

11.  0 

17.4 

7.2 

Choice 

46 

25 

37 

19 

freq.    % 

17.4 

9.  5 

14.  0 

7.2 
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Logical 


Explanatory 


122 


Table  Fl   (Cont'd, 


Lecture  Type* 


Choice  Condition  HC-HE  HC-LE  LC-HE  LC-LE 


**  Energetic 

No  choice 

25 

45 

27 

34 

freq.    % 

9.5 

17.  0 

10.2 

12.9 

Choice 

64 

9 

56 

4 

freq.    % 

24.2 

3.4 

21.2 

1.5 

No  choice 

63 

34 

66 

22 

freq.    % 

23.9 

12.9 

25.  0 

8.3 

Choice 

26 

20 

17 

16 

freq.    % 

9.8 

7.6 

6.4 

6.1 

No  choice 

41 

30 

50 

14 

freq.    % 

15.5 

11.4 

18.9 

5.3 

Choice 

48 

24 

33 

24 

freq.    % 

18.2 

9.1 

12.  5 

9.1 

**  Inspiring 

No  choice 

74 

49 

64 

38 

freq.    % 

28.0 

18.  6 

24.2 

14.4 

Choice 

15 

5 

19 

0 

freq.    % 

5.7 

1.9 

7.2 

0.  0 

Understandable 


No  choice 

35 

27 

41 

19 

freq.    % 

13.3 

10.2 

15.5 

7.2 

Choice 

54 

27 

42 

19 

freq.    % 

20.  5 

10.2 

15.9 

7.2 
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Table  Fl   (Cont'd. 


Lecture  Type=!= 


Choice  Condition 

HC-KE 

HC-LE 

LC-HE 

LC-LE 

Well-Paced 

No  choice 

67 

35 

53 

24 

freq.    % 

25.4 

13.3 

20.  1 

9.  1 

Choice 

22 

19 

30 

14 

freq.    % 

8.3 

7.2 

11.4 

5.  3 

**  Expressive 

No  choice 

39 

44 

37 

35 

freq.    % 

14.8 

16.7 

14.  0 

13.3 

Choice 

50 

10 

46 

3 

freq.    % 

18.9 

3.8 

17.4 

1.1 

**  Forceful 

No  choice 

60 

52 

66 

37 

freq.    % 

22.7 

19.7 

25.0 

14.  0 

Choice 

29 

2 

17 

1 

freq.    % 

11.0 

0.8 

6.4 

0.4 

**  Interesting 

No  choice 

52 

47 

58 

35 

freq.    % 

19.7 

17.8 

22,  0 

13.4 

Choice 

37 

7 

25 

3 

freq.    % 

14.  0 

2.6 

9.5 

1.  1 

Variety- 

No  choice 

79 

49 

74 

38 

freq.    % 

29.9 

18.  6 

28.0 

14.4 

Choice 

10 

5 

9 

0 

freq.    % 

3.8 

20.8 

3.4 

0.  0 
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Table  Fl   (Cont'd.  ) 


**  Stimulating 


Lecture  Type* 


Choice  Condition  HC-HE  HC-LE  LC-HE  LC-LE 


No  choice 

59 

49 

69 

38 

freq.    % 

22.4 

18.6 

26.  1 

14.4 

Choice 

30 

5 

14 

0 

freq.    % 

61.2 

1.9 

5.3 

0.  0 

**  Interested 


No  choice 

51 

44 

51 

31 

freq.    % 

19.3 

16.7 

19.3 

11.7 

Choice 

38 

10 

32 

7 

freq.    % 

14.4 

3.8 

12.1 

2.7 

-.■^-  Warm 


No  choice 

67 

51 

65 

37 

freq.    % 

25.4 

19.3 

24.6 

14.0 

Choice 

22 

3 

18 

1 

freq.    % 

8.3 

1.1 

6.8 

0.4 

Scholarly 


No  choice 

67 

39 

67 

21 

freq.    % 

25.4 

14.8 

25.4 

7.9 

Choice 

22 

15 

16 

17 

freq.    % 

8.3 

5.7 

6.1 

6.4 

^'i'  Orderly 


No  choice 

66 

30 

64 

21 

freq.    % 

25.  0 

11.4 

24.2 

7.9 

Choice 

23 

24 

19 

17 

freq.    % 

8.7 

9.1 

7.2 

6.4 
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Table  Fl   (Cont'd.  ) 


Lecture  Type-' 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Stylized 

No  choice 

87 

49 

75 

38 

freq.    % 

32.9 

18.6 

28.4 

14.4 

Choice 

2 

5 

8 

0 

freq.    % 

0.8 

1.9 

3.  0 

0.  0 

**  Motivating 

No  choice 

60 

53 

66 

36 

freq.    % 

22.7 

20.  1 

25.0 

13.6 

Choice 

29 

1 

17 

2 

freq.    % 

11.  0 

0.4 

6.4 

0.8 

Masterful 

No  choice 

80 

50 

74 

34 

freq.    % 

30.3 

18.9 

28.  0 

12.9 

Choice 

9 

4 

9 

4 

freq.    % 

3.4 

1.  5 

3.4 

1.  5 

=:-*  Enthusiastic 

No  choice 

26 

49 

35 

36 

freq.    % 

9.9 

18.6 

13.3 

13.6 

Choice 

63 

5 

48 

2 

freq.    % 

23,7 

1.9 

18.2 

0.8 

Showmanship 

No  choice 

75 

52 

76 

37 

freq.    7o 

28.4 

19.7 

28.8 

14.0 

Choice 

14 

2 

7 

1 

freq.    % 

5.  3 

0.8 

2.6 

0.4 
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Table  Fl   (Cont'd.  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Vital 

No  choice 

8Z 

53 

77 

38 

freq.    % 

31.  1 

20.  1 

29.2 

14.4 

Choice 

7 

1 

6 

0 

freq.    % 

2.6 

0.4 

2.3 

0.0 

Concise 

No  choice 

73 

42 

71 

28 

freq.    % 

27.7 

15.9 

26.9 

10.6 

Choice 

16 

12 

12 

10 

freq.    % 

6.1 

4.5 

4.  5 

3.8 

Lucid 

No  choice 

83 

51 

80 

36 

freq.    % 

31.4 

19.3    ■ 

30.3 

13.6 

Choice 

6 

3 

3 

2 

freq.    % 

2.3 

1.1 

1.  1 

0.8 

**  Enjoyable 

No  choice 

61 

49 

60 

36 

freq,    % 

23.  1 

18.6 

22,7 

13.6 

Choice 

28 

5 

23 

2 

freq.    % 

10.6 

1.  9 

8.7 

0.8 

Clear 

No  choice 

45 

33 

43 

16 

freq.    % 

17.0 

12.  5 

16.3 

6.1 

Choice 

44 

21 

40 

22 

freq.    % 

16.7 

7.9 

15.2 

8.  3 
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Table  Fl   (Cont'd.  ) 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Inventive 

No  choice 

82 

53 

74 

38 

freq.    % 

31.1 

20.  1 

28.0 

14.4 

Choice 

7 

1 

9 

0 

freq.    % 

2.6 

0.4 

3.4 

0.0 

Cultured 

No  choice 

86 

51 

79 

32 

freq.    % 

32.6 

19.  3 

29.9 

12.1 

Choice 

3 

3 

4 

6 

freq.    % 

1.  1 

1.  1 

1.  5 

2.  3 

Confident 

No  choice 

42 

34 

43 

23 

freq.    % 

15.9 

12.9 

16.3 

8.7 

Choice 

47 

20 

40 

15 

freq.    % 

17.8 

7.6 

15.  1 

5.7 

Poised 

No  choice 

65 

46 

68 

28 

freq.    % 

24.  6 

17.4 

25.8 

10.6 

Choice 

24 

8 

15 

10 

freq.    % 

9.1 

3.  0 

5.7 

3.8 

**  Humorous 

No  choice 

46 

48 

42 

38 

freq.    % 

17.4 

18.2 

15.9 

14.4 

Choice 

43 

6 

41 

0 

freq.    % 

16.3 

2.  3 

15.  5 

0.0 
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Table  Fl   (Cont'd.  ) 


Lecture  Type-'!= 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

**  Sparkling 

No  choice 

71 

52 

70 

38 

freq.    % 

26.9 

19.7 

26.  5 

14.4 

Choice 

14 

2 

13 

0 

freq.    % 

6.8 

0.8 

4.9 

0.0 

Competent 

No  choice 

57 

40 

65 

27 

freq.    % 

21.6 

15.2 

24.6 

10.2 

Choice 

32 

14 

18 

11 

freq.    % 

12.1 

5.3 

6.8 

4.2 

Charismatic 

No  choice 

81 

54 

76 

38 

freq.    % 

30.7 

20.  5 

28.8 

14.4 

Choice 

8 

0 

7 

0 

freq.    % 

3.0 

0.0 

2.6 

0.0 

Conscientious 

No  choice 

81 

51 

76 

33 

freq.    % 

30.7 

19.3 

28.8 

12.5 

Choice 

8 

3 

7 

5 

freq.    % 

3.0 

1.1 

2.6 

1.9 

**  Dynamic 

No  choice 

66 

53 

73 

38 

freq.    % 

25.0 

20.  1 

27.6 

14.4 

Choice 

23 

1 

10 

0 

freq,    % 

8.7 

0.4 

3.8 

0.  0 
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Table  Fl  (Cont'd. 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Well -Groomed 

No  choice 

76 

47 

71 

31 

freq.    % 

28.8 

17.8 

26.9 

11.7 

Choice 

13 

7 

12 

7 

freq.    % 

4.9 

2.6 

4.  6 

2.6 

Organized 

No  choice 

49 

28 

40 

16 

freq.    % 

18.6 

10,  6 

15.2 

6.1 

Choice 

40 

26 

43 

22 

freq.    % 

15.2 

9.8 

16.3 

8.3 

Careful 

No  choice 

83 

46 

78 

33 

freq.    % 

31.4 

17.4 

29.6 

12.5 

Choice 

6 

8 

5 

5 

freq.    % 

2.3 

3.0 

1.9 

1.9 

**  Wittv 

No  choice 

62 

50 

61 

38 

freq.    % 

23.  5 

18.9 

23.  1 

14,4 

Choice 

27 

4 

22 

0 

freq.    % 

10.2 

1.  5 

8.3 

0.  0 

Unique 

No  choice 

79 

52 

76 

36 

freq.    % 

29.9 

19.7 

28.8 

13.6 

Choice 

10 

2 

7 

2 

freq.   % 

3.8 

0.8 

2.6 

0.8 
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Table  Fl   (Cont'd. 


Lecture  Type* 


Choice  Condition 

HC-HE 

HC-LE 

LC-HE 

LC-LE 

Persuasive 

No  choice 

74 

54 

73 

34 

freq.    % 

28.0 

20.  5 

27.6 

12.9 

Choice 

15 

0 

10 

4 

freq.    % 

5.7 

0.0 

3.8 

1.5 

*    HC  -  High  Content 
EC  -   Low  Content 
HE  -  High  Expressiveness 
LE  -  Low  Expressiveness 
**  X     significant  at  p  <  ,  01  for  3  degrees  of  freedom 
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